Open Source LLM Observability & Evaluation using OpenTelemetry
A curated collection of the best open source tracing, monitoring, and evaluation platforms for LLM and AI-agent applications. using OpenTelemetry.
Open source LLM engineering platform for AI-powered applications
Stars
Stars growing over the last 30 days36,781Last commit
12 hours agoLicense
MIT
Langfuse provides tracing, evaluations, prompt management, and analytics to debug and improve LLM applications.
Open Source Alternative to:
Open-source LLM tracing & evaluation for AI optimization
Stars
Stars growing over the last 30 days12,079Last commit
59 minutes agoLicense
Elastic-2.0
Open-source platform for LLM tracing, evaluation, and optimization. Features automatic instrumentation, prompt playground, and real-time AI application monitoring.
Open Source Alternative to:
Build, automate, and improve AI agents with your team
Stars
4,878Last commit
54 minutes agoLicense
MIT
Open-source workspace for building and running AI agents: chat-driven development, scheduling, human-in-the-loop approvals, versioning, and tracing. Self-host or use the cloud.
Open Source Alternative to:
Simulation-based testing and evaluation for AI agents
Stars
5,001Last commit
14 minutes agoLicense
Apache-2.0
Tests AI agents through multi-turn simulations, LLM-based scoring, and production tracing so teams can ship reliable agents with confidence.
Open Source Alternative to:
Monitor, debug, and scale LLM applications with ease
Stars
Stars growing over the last 30 days2,896Last commit
11 hours agoLicense
Apache-2.0
Open-source observability platform for GenAI and LLM applications. Real-time monitoring, distributed tracing, prompt management, and AI model evaluation built on OpenTelemetry.
Open Source Alternative to:
InfluxDB – The purpose-built time series platform for high-velocity ingestion and real-time queries at scale.
Postiz