Open Source LLM Observability & Evaluation using OpenTelemetry
A curated collection of the best open source tracing, monitoring, and evaluation platforms for LLM and AI-agent applications. using OpenTelemetry.
Open source LLM engineering platform for AI-powered applications
Stars
33,983Last commit
3 hours agoLicense
MIT
Langfuse provides tracing, evaluations, prompt management, and analytics to debug and improve LLM applications.
Open Source Alternative to:
Open-source LLM tracing & evaluation for AI optimization
Stars
11,264Last commit
4 hours agoLicense
Elastic-2.0
Open-source platform for LLM tracing, evaluation, and optimization. Features automatic instrumentation, prompt playground, and real-time AI application monitoring.
Open Source Alternative to:
Build, automate, and improve AI agents with your team
Stars
4,655Last commit
3 hours agoLicense
MIT
Open-source workspace for building and running AI agents: chat-driven development, scheduling, human-in-the-loop approvals, versioning, and tracing. Self-host or use the cloud.
Open Source Alternative to:
Simulation-based testing and evaluation for AI agents
Stars
3,519Last commit
4 hours agoLicense
Apache-2.0
Tests AI agents through multi-turn simulations, LLM-based scoring, and production tracing so teams can ship reliable agents with confidence.
Open Source Alternative to:
Monitor, debug, and scale LLM applications with ease
Stars
2,734Last commit
4 hours agoLicense
Apache-2.0
Open-source observability platform for GenAI and LLM applications. Real-time monitoring, distributed tracing, prompt management, and AI model evaluation built on OpenTelemetry.
Open Source Alternative to:
Sevalla – Deploy your app before your coffee gets cold. It’s that easy. Try Sevalla with $50 free credit.
Sevalla