Self-hosted LLM Observability & Evaluation
A curated collection of the best self-hosted tracing, monitoring, and evaluation platforms for LLM and AI-agent applications.
Open source LLM engineering platform for AI-powered applications
Stars
33,657Last commit
10 hours agoLicense
MIT
Langfuse provides tracing, evaluations, prompt management, and analytics to debug and improve LLM applications.
Open Source Alternative to:
Open-source LLM tracing & evaluation for AI optimization
Stars
11,174Last commit
2 hours agoLicense
Elastic-2.0
Open-source platform for LLM tracing, evaluation, and optimization. Features automatic instrumentation, prompt playground, and real-time AI application monitoring.
Open Source Alternative to:
Full observability for AI agents in production
Stars
4,601Last commit
19 hours agoLicense
MIT
Open-source platform for monitoring AI agents: captures traces, surfaces failure patterns, alerts on issues, and helps you verify fixes with automated evals.
Open Source Alternative to:
Build reliable LLM apps with integrated workflows
Stars
4,528Last commit
8 hours agoLicense
MIT
Open-source LLMOps platform providing prompt management, evaluation, and observability tools for building robust AI applications with team collaboration.
Open Source Alternative to:
AI-powered platform for engineering LLM products
Stars
3,191Last commit
16 hours agoLicense
Apache-2.0
Laminar is an open-source platform that helps collect, understand, and utilize data for building high-quality LLM applications.
Open Source Alternative to:
LLM observability: cost, latency, and traces in one place
Stars
12Last commit
1 day agoLicense
MIT
Drop-in observability platform for OpenAI, Anthropic, and Gemini that logs every request, tracks costs, traces agent workflows, and flags anomalies and PII.
Open Source Alternative to:
Capture – Capture screenshots, generate PDFs, scrape content, extract metadata, and automate browsers with one API.
Capture