Open Source LLM Observability & Evaluation using Sentry
A curated collection of the best open source tracing, monitoring, and evaluation platforms for LLM and AI-agent applications. using Sentry.
Open source LLM engineering platform for AI-powered applications
Stars
Stars growing over the last 30 days36,762Last commit
12 hours agoLicense
MIT
Langfuse provides tracing, evaluations, prompt management, and analytics to debug and improve LLM applications.
Open Source Alternative to:
Build reliable AI apps with comprehensive observability
Stars
6,248Last commit
3 days agoLicense
Apache-2.0
Open-source platform for logging, monitoring, and debugging LLM applications. Route, debug, and analyze AI apps with comprehensive observability tools.
Open Source Alternative to:
Simulation-based testing and evaluation for AI agents
Stars
5,001Last commit
12 hours agoLicense
Apache-2.0
Tests AI agents through multi-turn simulations, LLM-based scoring, and production tracing so teams can ship reliable agents with confidence.
Open Source Alternative to:
Full observability for AI agents in production
Stars
4,740Last commit
2 days agoLicense
MIT
Open-source platform for monitoring AI agents: captures traces, surfaces failure patterns, alerts on issues, and helps you verify fixes with automated evals.
Open Source Alternative to:
LLM observability: cost, latency, and traces in one place
Stars
13Last commit
5 days agoLicense
MIT
Drop-in observability platform for OpenAI, Anthropic, and Gemini that logs every request, tracks costs, traces agent workflows, and flags anomalies and PII.
Open Source Alternative to:
Openlane – Open-source, developer-first platform for automated compliance, risk management, and built-in Trust Center.
Capture