Open Source LLM Observability & Evaluation using Prometheus
A curated collection of the best open source tracing, monitoring, and evaluation platforms for LLM and AI-agent applications. using Prometheus.
Open-source LLM tracing & evaluation for AI optimization
Stars
11,607Last commit
13 hours agoLicense
Elastic-2.0
Open-source platform for LLM tracing, evaluation, and optimization. Features automatic instrumentation, prompt playground, and real-time AI application monitoring.
Open Source Alternative to:
Simulation-based testing and evaluation for AI agents
Stars
4,872Last commit
17 hours agoLicense
Apache-2.0
Tests AI agents through multi-turn simulations, LLM-based scoring, and production tracing so teams can ship reliable agents with confidence.
Open Source Alternative to:
Windshift – The self-hosted platform that replaces Jira.
Windshift