Skip to main content
AgentsUse

Observability and Evaluation

Langfuse

Open source LLM engineering platform for tracing, prompt management, evaluation, and debugging of AI applications.

freemiumMITChecked 2026-10-07Source verified

Quick decision

Best for
Teams that want open source, self-hostable tracing and evaluation with prompt management and framework-agnostic integrations.
Not ideal for
Teams that prefer a fully managed service with no self-hosting operations, or that need enterprise security features without a commercial license.
Pricing model
Freemium model with a free Hobby tier for Langfuse Cloud and paid Core, Pro, and Enterprise tiers. Cloud pricing is based on ingested units defined as traces plus observations plus scores, with graduated per-unit rates. Self-hosted open source use is free under MIT, while self-hosted Enterprise features are commercially licensed.
Deployment
cloud. self-hosted. docker. kubernetes.
Authentication
API keys with public and secret project keys via environment variables
Review state
Source verified. Facts checked 2026-10-07. Not locally tested by AgentsUse.

What it does

Langfuse is an open source platform for developing, monitoring, evaluating, and debugging LLM applications. The GitHub README describes tracing of LLM calls along with retrieval, embedding, and agent actions, with inspection of logs and user sessions through a web UI and demo project.

Core product areas listed in the README include LLM application observability, prompt management with versioning and caching, evaluations using LLM-as-a-judge, code evaluators, user feedback, and manual labeling, plus datasets for test sets and experiments. A playground links traced outputs to prompt iteration, and a comprehensive API with Python and JS/TS SDKs supports custom workflows.

Deployment options cover Langfuse Cloud with a free tier and self-hosting via Docker Compose, virtual machines, Kubernetes with Helm, and Terraform templates for AWS, Azure, and GCP. The homepage notes support for OpenTelemetry instrumentation and 100+ integrations across languages, frameworks, and model providers.

Verified capabilities

Observability

  • LLM tracing and observability Source verified

    Instrument applications to ingest traces covering LLM calls, retrieval, embedding, and agent actions for inspection and debugging.

Prompts

  • Prompt management Source verified

    Centrally manage, version, and collaboratively iterate on prompts with server and client caching.

Evaluation

  • Evaluations Source verified

    Run LLM-as-a-judge, code evaluators, user feedback collection, manual labeling, and custom evaluation pipelines via API and SDKs.

  • Datasets and experiments Source verified

    Create test sets and benchmarks for pre-deployment testing and structured experiments integrated with frameworks.

Development

  • LLM playground Source verified

    Test and iterate on prompts and model configurations directly from traced outputs.

Integrations

  • OpenTelemetry and integrations Source verified

    Works with OpenTelemetry instrumentation and integrations including OpenAI, LangChain, LlamaIndex, LiteLLM, and Vercel AI SDK.

Quick start

Log your first LLM call with the Python SDK

Create a Langfuse project and API credentials, install the SDK, set project keys, and trace a function with the observe decorator and OpenAI integration as shown in the README quickstart.

Log your first LLM call with the Python SDK
pip install langfuse openai

from langfuse import observe
from langfuse.openai import openai

@observe()
def story():
    return openai.chat.completions.create(
        model="gpt-4o",
        messages=[{"role": "user", "content": "What is Langfuse?"}],
    ).choices[0].message.content

Source: https://github.com/langfuse/langfuse. Examples use placeholders only. Never paste a real key into a profile, config file you share, or a ticket.

MCP support: The Langfuse homepage states that SKILL.md, CLI, and MCP connect coding agents to Langfuse for work in the app or IDE.

Works with

Frameworks

LangChain, LlamaIndex, Haystack, Vercel AI SDK, Mastra, and other frameworks listed in the README integrations table.

Packages

Python and JS/TS SDKs with OpenAI drop-in instrumentation and LiteLLM support for 100+ models.

API

Comprehensive public API with OpenAPI spec, Postman collection, and typed SDKs.

Deployment

Langfuse Cloud, Docker Compose, Kubernetes Helm, and Terraform templates for AWS, Azure, and GCP.

Only sourced support is listed. A missing framework means AgentsUse has not verified it yet, not that it cannot work.

Health and maintenance

GitHub stars

35,501

Checked 2026-10-07

GitHub forks

3,947

Checked 2026-10-07

Package
PyPI: langfuse, version 4.17.0
License
Open source, MIT
Maintainer
Langfuse

Stars and forks read from the fetched GitHub repository page. PyPI version from a registry release check dated 2026-10-05 listing langfuse 4.17.0. Weekly downloads not read in this run, so omitted.

Pricing and license

Freemium model with a free Hobby tier for Langfuse Cloud and paid Core, Pro, and Enterprise tiers. Cloud pricing is based on ingested units defined as traces plus observations plus scores, with graduated per-unit rates. Self-hosted open source use is free under MIT, while self-hosted Enterprise features are commercially licensed.

Official pricing or docs →

Limitations and safety

  • Self-hosting requires operating Docker or Kubernetes infrastructure including Postgres, ClickHouse, Redis, and object storage components described in the self-hosting docs.
  • Enterprise security and platform features such as SCIM, audit logs, and data retention policies remain under a commercial license, separate from the MIT open source core.
  • Cloud cost scales with total units, so a single agent run with many observations and scores counts as multiple billable units.
Safety

Browser and data tools can read pages, fill forms, and download files. Start with a test account or read-only access, keep credentials in environment variables, and review agent actions before connecting anything that can spend money, send messages, or delete data.

Alternatives to Langfuse

Common questions

What does Langfuse do for an AI agent?

Open source LLM engineering platform for tracing, prompt management, evaluation, and debugging of AI applications.

Is Langfuse open source?

Yes. This profile records the license as MIT from the official repository.

Does Langfuse support MCP?

The Langfuse homepage states that SKILL.md, CLI, and MCP connect coding agents to Langfuse for work in the app or IDE.

Sources and freshness

Last checked 2026-10-07. Verification label: source verified, which means public claims trace to the sources above. It does not mean AgentsUse ran the tool. Spotted an error? Send a correction. Back to the tools directory.