Self-hosted LLM Observability & Evaluation
A curated collection of the best self-hosted tracing, monitoring, and evaluation platforms for LLM and AI-agent applications..
Open source LLM engineering platform for AI-powered applications
Stars
Stars growing over the last 30 days36,500Last commit
12 hours agoLicense
MIT
Langfuse provides tracing, evaluations, prompt management, and analytics to debug and improve LLM applications.
Open Source Alternative to:
Open-source LLM tracing & evaluation for AI optimization
Stars
Stars growing over the last 30 days12,005Last commit
12 hours agoLicense
Elastic-2.0
Open-source platform for LLM tracing, evaluation, and optimization. Features automatic instrumentation, prompt playground, and real-time AI application monitoring.
Open Source Alternative to:
Build, automate, and improve AI agents with your team
Stars
4,862Last commit
12 hours agoLicense
MIT
Open-source workspace for building and running AI agents: chat-driven development, scheduling, human-in-the-loop approvals, versioning, and tracing. Self-host or use the cloud.
Open Source Alternative to:
Full observability for AI agents in production
Stars
4,734Last commit
12 hours agoLicense
MIT
Open-source platform for monitoring AI agents: captures traces, surfaces failure patterns, alerts on issues, and helps you verify fixes with automated evals.
Open Source Alternative to:
AI-powered platform for engineering LLM products
Stars
Stars growing over the last 30 days3,443Last commit
23 hours agoLicense
Apache-2.0
Laminar is an open-source platform that helps collect, understand, and utilize data for building high-quality LLM applications.
Open Source Alternative to:
Monitor, debug, and scale LLM applications with ease
Stars
Stars growing over the last 30 days2,883Last commit
14 hours agoLicense
Apache-2.0
Open-source observability platform for GenAI and LLM applications. Real-time monitoring, distributed tracing, prompt management, and AI model evaluation built on OpenTelemetry.
Open Source Alternative to:
LLM observability: cost, latency, and traces in one place
Stars
13Last commit
14 hours agoLicense
MIT
Drop-in observability platform for OpenAI, Anthropic, and Gemini that logs every request, tracks costs, traces agent workflows, and flags anomalies and PII.
Open Source Alternative to:
Docmost – Open-source wiki software with real-time collaboration, diagrams, AI, SSO, RBAC permissions and more.
Stellar Hosted