Open Source LLM Observability & Evaluation using Vercel
A curated collection of the best open source tracing, monitoring, and evaluation platforms for LLM and AI-agent applications. using Vercel.
Build reliable AI apps with comprehensive observability
Stars
6,132Last commit
5 days agoLicense
Apache-2.0
Open-source platform for logging, monitoring, and debugging LLM applications. Route, debug, and analyze AI apps with comprehensive observability tools.
Open Source Alternative to:
Build, automate, and improve AI agents with your team
Stars
4,683Last commit
5 hours agoLicense
MIT
Open-source workspace for building and running AI agents: chat-driven development, scheduling, human-in-the-loop approvals, versioning, and tracing. Self-host or use the cloud.
Open Source Alternative to:
LLM observability: cost, latency, and traces in one place
Stars
13Last commit
5 days agoLicense
MIT
Drop-in observability platform for OpenAI, Anthropic, and Gemini that logs every request, tracks costs, traces agent workflows, and flags anomalies and PII.
Open Source Alternative to:
Stellar Hosted – Managed Open Source software hosting in the EU: secure, compliant, fast.
CodeRabbit