Open Source LLM Observability & Evaluation using Dependabot
A curated collection of the best open source tracing, monitoring, and evaluation platforms for LLM and AI-agent applications. using Dependabot.
Open source LLM engineering platform for AI-powered applications
Stars
Stars growing over the last 30 days36,194Last commit
1 hour agoLicense
MIT
Langfuse provides tracing, evaluations, prompt management, and analytics to debug and improve LLM applications.
Open Source Alternative to:
Open-source LLM tracing & evaluation for AI optimization
Stars
Stars growing over the last 30 days11,953Last commit
1 hour agoLicense
Elastic-2.0
Open-source platform for LLM tracing, evaluation, and optimization. Features automatic instrumentation, prompt playground, and real-time AI application monitoring.
Open Source Alternative to:
Monitor LLM performance with open-source observability
Stars
7,500Last commit
3 days agoLicense
Apache-2.0
Open-source observability platform for LLMs using OpenTelemetry. Monitor performance, track costs, and debug AI applications with just 2 lines of code.
Open Source Alternative to:
Simulation-based testing and evaluation for AI agents
Stars
4,987Last commit
1 hour agoLicense
Apache-2.0
Tests AI agents through multi-turn simulations, LLM-based scoring, and production tracing so teams can ship reliable agents with confidence.
Open Source Alternative to:
Monitor, debug, and scale LLM applications with ease
Stars
2,870Last commit
10 hours agoLicense
Apache-2.0
Open-source observability platform for GenAI and LLM applications. Real-time monitoring, distributed tracing, prompt management, and AI model evaluation built on OpenTelemetry.
Open Source Alternative to:
LLM observability: cost, latency, and traces in one place
Stars
13Last commit
4 days agoLicense
MIT
Drop-in observability platform for OpenAI, Anthropic, and Gemini that logs every request, tracks costs, traces agent workflows, and flags anomalies and PII.
Open Source Alternative to:
Sent – Messaging Infrastructure for Developers. One API for SMS, WhatsApp, and RCS across 190+ countries.
Stellar Hosted