Skip to main content
AgentsUse

Observability and Evaluation

Helicone

Open source AI gateway and LLM observability platform with one-line integration to monitor, evaluate, and route requests.

freemiumApache-2.0Checked 2026-10-07Source verified

Quick decision

Best for
Teams that want fast proxy-based logging, a unified gateway to many models, and cost and latency dashboards with an open source self-host option.
Not ideal for
Teams that need manual deployment without Docker or Helm, or deep dataset and experiment workflows as the primary use case.
Pricing model
Freemium model with a free Hobby tier including a monthly request allowance and limited storage and retention, paid Pro and Team tiers with usage-based pricing beyond included requests, and custom Enterprise pricing with SSO and on-prem deployment. The pricing page describes simple, predictable pricing that scales with usage.
Deployment
cloud. self-hosted. docker.
Authentication
API key via HELICONE_API_KEY passed to the gateway client
Review state
Source verified. Facts checked 2026-10-07. Not locally tested by AgentsUse.

What it does

Helicone describes itself as an AI Gateway and LLM Observability Platform for AI engineers. The GitHub README lists access to 100+ AI models through an OpenAI-compatible API with intelligent routing and automatic fallbacks, plus quick integration by changing a base URL and adding an API key for providers including OpenAI, Anthropic, Gemini, and frameworks such as LangChain and Vercel AI SDK.

Observability features in the README include inspecting and debugging traces and sessions for agents, chatbots, and document pipelines, analyzing cost, latency, and quality metrics with export to PostHog, a playground for testing prompts and traces, and prompt management with versioning and deployment through the gateway. The platform notes SOC 2 and GDPR compliance for enterprise use and a free tier measured in monthly requests.

The open source stack can be self-hosted with Docker using a docker-compose setup, with a production Helm chart available for enterprise workloads by contact. The architecture comprises a Next.js web frontend, a Cloudflare Workers proxy, a dedicated log collection server, Supabase for application data and auth, ClickHouse for analytics, and Minio for object storage.

Verified capabilities

Gateway

  • AI gateway routing Source verified

    Unified OpenAI-compatible API for 100+ models with intelligent routing and automatic fallbacks using one API key.

Observability

  • Request observability Source verified

    Log and inspect requests, traces, and sessions for agents, chatbots, and pipelines with cost and latency tracking.

Analytics

  • Cost and latency analytics Source verified

    Track cost, latency, and quality metrics and export to PostHog for custom dashboards.

Development

  • Playground Source verified

    Test and iterate on prompts, sessions, and traces in the web UI.

Prompts

  • Prompt management Source verified

    Version prompts using production data and deploy prompts through the AI Gateway without code changes.

Training

  • Fine-tuning partnerships Source verified

    Fine-tune workflows through partners listed in the README including OpenPipe and Autonomi.

Quick start

Route a request through the Helicone AI Gateway

Sign up for an API key from the README quick start, point an OpenAI client at the Helicone gateway base URL, and call a model so the request is logged.

Route a request through the Helicone AI Gateway
import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://ai-gateway.helicone.ai",
  apiKey: process.env.HELICONE_API_KEY,
});

const response = await client.chat.completions.create({
  model: "gpt-4o-mini",
  messages: [{ role: "user", content: "Hello!" }]
});

Source: https://github.com/Helicone/helicone. Examples use placeholders only. Never paste a real key into a profile, config file you share, or a ticket.

MCP support: The README notes data can be accessed with an MCP server, and the repository includes a helicone-mcp directory.

Works with

API

OpenAI-compatible AI Gateway API for JS/TS, Python, and cURL with unified provider access.

Frameworks

LangChain, LlamaIndex, LangGraph, Vercel AI SDK, Semantic Kernel, and CrewAI integrations listed in the README.

Packages

Async logging via OpenLLMetry for JS/TS and Python, plus direct provider integrations for OpenAI, Anthropic, Azure OpenAI, Bedrock, and Gemini.

Deployment

Managed cloud, Docker Compose self-hosting, and enterprise Helm chart by contact.

Only sourced support is listed. A missing framework means AgentsUse has not verified it yet, not that it cannot work.

Health and maintenance

GitHub stars

6,206

Checked 2026-10-07

GitHub forks

682

Checked 2026-10-07

License
Open source, Apache-2.0
Maintainer
Helicone

Stars, forks, and Apache-2.0 license read from the fetched GitHub repository page. No single canonical npm or PyPI package version was verified in this run, so package fields are left blank and weekly downloads are omitted.

Pricing and license

Freemium model with a free Hobby tier including a monthly request allowance and limited storage and retention, paid Pro and Team tiers with usage-based pricing beyond included requests, and custom Enterprise pricing with SSO and on-prem deployment. The pricing page describes simple, predictable pricing that scales with usage.

Official pricing or docs →

Limitations and safety

  • Manual self-hosted deployment is explicitly not recommended in the README, which directs users to Docker or Helm instead.
  • Production Helm chart for enterprise workloads requires contacting the vendor, rather than a public self-serve download described in the README.
  • Free tier is limited by monthly requests and short retention on the pricing page, so high-volume production logging requires a paid usage-based plan.
Safety

Browser and data tools can read pages, fill forms, and download files. Start with a test account or read-only access, keep credentials in environment variables, and review agent actions before connecting anything that can spend money, send messages, or delete data.

Alternatives to Helicone

Common questions

What does Helicone do for an AI agent?

Open source AI gateway and LLM observability platform with one-line integration to monitor, evaluate, and route requests.

Is Helicone open source?

Yes. This profile records the license as Apache-2.0 from the official repository.

Does Helicone support MCP?

The README notes data can be accessed with an MCP server, and the repository includes a helicone-mcp directory.

Sources and freshness

Last checked 2026-10-07. Verification label: source verified, which means public claims trace to the sources above. It does not mean AgentsUse ran the tool. Spotted an error? Send a correction. Back to the tools directory.