Submit
Ad
Learn more

Open Source Projects tagged "Llm Observability"

A curated collection of the best open source projects tagged "Llm Observability". Each listing includes a website screenshot along with a detailed review of its features.

Langfuse

AI
Open source LLM engineering platform for AI-powered applications

  • Stars

    Stars growing over the last 30 days37,363

  • Last commit

    5 hours ago

  • License

    MIT
Langfuse provides tracing, evaluations, prompt management, and analytics to debug and improve LLM applications.

Open Source Alternative to:

LangSmith

Bifrost

AI
Ultra-fast AI gateway with enterprise-grade reliability

  • Stars

    Stars growing over the last 30 days9,526

  • Last commit

    5 hours ago

  • License

    Apache-2.0
Open-source AI gateway delivering 50x faster performance than alternatives. Access 1000+ models from 8+ providers with built-in governance, fallback, and observability.

Open Source Alternative to:

OpenRouter

Helicone

AI
Build reliable AI apps with comprehensive observability

  • Stars

    6,279

  • Last commit

    18 hours ago

  • License

    Apache-2.0
Open-source platform for logging, monitoring, and debugging LLM applications. Route, debug, and analyze AI apps with comprehensive observability tools.

Open Source Alternative to:

DataDog

Agenta

AI
Build, automate, and improve AI agents with your team

  • Stars

    4,906

  • Last commit

    5 hours ago

  • License

    MIT
Open-source workspace for building and running AI agents: chat-driven development, scheduling, human-in-the-loop approvals, versioning, and tracing. Self-host or use the cloud.

Open Source Alternative to:

ChatGPT Work

Latitude

AI
Full observability for AI agents in production

  • Stars

    4,752

  • Last commit

    4 days ago

  • License

    MIT
Open-source platform for monitoring AI agents: captures traces, surfaces failure patterns, alerts on issues, and helps you verify fixes with automated evals.

Open Source Alternative to:

LangSmith

Logfire

AI
Powerful observability made simple for developers

  • Stars

    4,549

  • Last commit

    5 hours ago

  • License

    MIT
Logfire offers intuitive observability tools for Python applications, combining logs, profiling, and telemetry in one platform.

Open Source Alternative to:

DataDog

Laminar

AI
AI-powered platform for engineering LLM products

  • Stars

    Stars growing over the last 30 days3,485

  • Last commit

    6 hours ago

  • License

    Apache-2.0
Laminar is an open-source platform that helps collect, understand, and utilize data for building high-quality LLM applications.

Open Source Alternative to:

LangChain

OpenLIT

AI
Monitor, debug, and scale LLM applications with ease

  • Stars

    Stars growing over the last 30 days3,058

  • Last commit

    1 day ago

  • License

    Apache-2.0
Open-source observability platform for GenAI and LLM applications. Real-time monitoring, distributed tracing, prompt management, and AI model evaluation built on OpenTelemetry.

Open Source Alternative to:

LangSmith

Spanlens

AI
LLM observability: cost, latency, and traces in one place

  • Stars

    13

  • Last commit

    4 days ago

  • License

    MIT
Drop-in observability platform for OpenAI, Anthropic, and Gemini that logs every request, tracks costs, traces agent workflows, and flags anomalies and PII.

Open Source Alternative to:

LangSmith

Grepture

AI
Trace, evaluate, and protect every LLM call in one SDK

  • Stars

    12

  • Last commit

    3 days ago

  • License

    AGPL-3.0
An AI gateway that sits on the request path to handle PII redaction, prompt injection blocking, tracing, evals, and cost tracking for OpenAI, Anthropic, and Gemini.

Open Source Alternative to:

Vercel AI Gateway
Ad