Open Source LLM Observability & Evaluation using Sentry
A curated collection of the best open source tracing, monitoring, and evaluation platforms for LLM and AI-agent applications. using Sentry.
Open source LLM engineering platform for AI-powered applications
Stars
33,983Last commit
3 hours agoLicense
MIT
Langfuse provides tracing, evaluations, prompt management, and analytics to debug and improve LLM applications.
Open Source Alternative to:
Build reliable AI apps with comprehensive observability
Stars
6,118Last commit
16 hours agoLicense
Apache-2.0
Open-source platform for logging, monitoring, and debugging LLM applications. Route, debug, and analyze AI apps with comprehensive observability tools.
Open Source Alternative to:
Full observability for AI agents in production
Stars
4,608Last commit
4 hours agoLicense
MIT
Open-source platform for monitoring AI agents: captures traces, surfaces failure patterns, alerts on issues, and helps you verify fixes with automated evals.
Open Source Alternative to:
Simulation-based testing and evaluation for AI agents
Stars
3,519Last commit
4 hours agoLicense
Apache-2.0
Tests AI agents through multi-turn simulations, LLM-based scoring, and production tracing so teams can ship reliable agents with confidence.
Open Source Alternative to:
LLM observability: cost, latency, and traces in one place
Stars
13Last commit
16 hours agoLicense
MIT
Drop-in observability platform for OpenAI, Anthropic, and Gemini that logs every request, tracks costs, traces agent workflows, and flags anomalies and PII.
Open Source Alternative to:
Sevalla – Deploy your app before your coffee gets cold. It’s that easy. Try Sevalla with $50 free credit.
Docmost