Helicone
Open source AI gateway and LLM observability platform with one-line integration to monitor, evaluate, and route requests.
Quick decision
What it does
Helicone describes itself as an AI Gateway and LLM Observability Platform for AI engineers. The GitHub README lists access to 100+ AI models through an OpenAI-compatible API with intelligent routing and automatic fallbacks, plus quick integration by changing a base URL and adding an API key for providers including OpenAI, Anthropic, Gemini, and frameworks such as LangChain and Vercel AI SDK.
Observability features in the README include inspecting and debugging traces and sessions for agents, chatbots, and document pipelines, analyzing cost, latency, and quality metrics with export to PostHog, a playground for testing prompts and traces, and prompt management with versioning and deployment through the gateway. The platform notes SOC 2 and GDPR compliance for enterprise use and a free tier measured in monthly requests.
The open source stack can be self-hosted with Docker using a docker-compose setup, with a production Helm chart available for enterprise workloads by contact. The architecture comprises a Next.js web frontend, a Cloudflare Workers proxy, a dedicated log collection server, Supabase for application data and auth, ClickHouse for analytics, and Minio for object storage.
Verified capabilities
Gateway
AI gateway routing Source verified
Unified OpenAI-compatible API for 100+ models with intelligent routing and automatic fallbacks using one API key.
Observability
Request observability Source verified
Log and inspect requests, traces, and sessions for agents, chatbots, and pipelines with cost and latency tracking.
Analytics
Cost and latency analytics Source verified
Track cost, latency, and quality metrics and export to PostHog for custom dashboards.
Development
Playground Source verified
Test and iterate on prompts, sessions, and traces in the web UI.
Prompts
Prompt management Source verified
Version prompts using production data and deploy prompts through the AI Gateway without code changes.
Training
Fine-tuning partnerships Source verified
Fine-tune workflows through partners listed in the README including OpenPipe and Autonomi.
Quick start
Route a request through the Helicone AI Gateway
Sign up for an API key from the README quick start, point an OpenAI client at the Helicone gateway base URL, and call a model so the request is logged.
import OpenAI from "openai";
const client = new OpenAI({
baseURL: "https://ai-gateway.helicone.ai",
apiKey: process.env.HELICONE_API_KEY,
});
const response = await client.chat.completions.create({
model: "gpt-4o-mini",
messages: [{ role: "user", content: "Hello!" }]
});Source: https://github.com/Helicone/helicone. Examples use placeholders only. Never paste a real key into a profile, config file you share, or a ticket.
MCP support: The README notes data can be accessed with an MCP server, and the repository includes a helicone-mcp directory.
Works with
API
OpenAI-compatible AI Gateway API for JS/TS, Python, and cURL with unified provider access.
Frameworks
LangChain, LlamaIndex, LangGraph, Vercel AI SDK, Semantic Kernel, and CrewAI integrations listed in the README.
Packages
Async logging via OpenLLMetry for JS/TS and Python, plus direct provider integrations for OpenAI, Anthropic, Azure OpenAI, Bedrock, and Gemini.
Deployment
Managed cloud, Docker Compose self-hosting, and enterprise Helm chart by contact.
Only sourced support is listed. A missing framework means AgentsUse has not verified it yet, not that it cannot work.
Health and maintenance
6,206
Checked 2026-10-07
682
Checked 2026-10-07
Stars, forks, and Apache-2.0 license read from the fetched GitHub repository page. No single canonical npm or PyPI package version was verified in this run, so package fields are left blank and weekly downloads are omitted.
Pricing and license
Freemium model with a free Hobby tier including a monthly request allowance and limited storage and retention, paid Pro and Team tiers with usage-based pricing beyond included requests, and custom Enterprise pricing with SSO and on-prem deployment. The pricing page describes simple, predictable pricing that scales with usage.
Limitations and safety
- Manual self-hosted deployment is explicitly not recommended in the README, which directs users to Docker or Helm instead.
- Production Helm chart for enterprise workloads requires contacting the vendor, rather than a public self-serve download described in the README.
- Free tier is limited by monthly requests and short retention on the pricing page, so high-volume production logging requires a paid usage-based plan.
Browser and data tools can read pages, fill forms, and download files. Start with a test account or read-only access, keep credentials in environment variables, and review agent actions before connecting anything that can spend money, send messages, or delete data.
Alternatives to Helicone
Langfuse
Open source tracing, datasets, and evaluation with self-hosting and prompt management.
Tradeoff: Requires SDK instrumentation or OTel setup rather than a single base URL proxy change.
LangSmith
Managed agent tracing and evaluation with monitoring, insights, and LangChain ecosystem integration.
Tradeoff: Closed platform with per-seat pricing, versus Helicone open source gateway model.
Braintrust
Evaluation platform with experiments, scorers, and production trace analysis.
Tradeoff: Proprietary and per-score pricing, focused more on eval workflows than gateway routing.
Common questions
What does Helicone do for an AI agent?
Open source AI gateway and LLM observability platform with one-line integration to monitor, evaluate, and route requests.
Is Helicone open source?
Yes. This profile records the license as Apache-2.0 from the official repository.
Does Helicone support MCP?
The README notes data can be accessed with an MCP server, and the repository includes a helicone-mcp directory.
Sources and freshness
- GitHub repository: https://github.com/Helicone/helicone
- Homepage: https://helicone.ai
- Pricing: https://helicone.ai/pricing
Last checked 2026-10-07. Verification label: source verified, which means public claims trace to the sources above. It does not mean AgentsUse ran the tool. Spotted an error? Send a correction. Back to the tools directory.