Open Source LLM Observability & Evaluation using AWS
A curated collection of the best open source tracing, monitoring, and evaluation platforms for LLM and AI-agent applications. using AWS.
Open source LLM engineering platform for AI-powered applications
Stars
33,638Last commit
11 hours agoLicense
MIT
Langfuse provides tracing, evaluations, prompt management, and analytics to debug and improve LLM applications.
Open Source Alternative to:
Build reliable AI apps with comprehensive observability
Stars
6,098Last commit
1 day agoLicense
Apache-2.0
Open-source platform for logging, monitoring, and debugging LLM applications. Route, debug, and analyze AI apps with comprehensive observability tools.
Open Source Alternative to:
Full observability for AI agents in production
Stars
4,599Last commit
16 hours agoLicense
MIT
Open-source platform for monitoring AI agents: captures traces, surfaces failure patterns, alerts on issues, and helps you verify fixes with automated evals.
Open Source Alternative to:
AI-powered platform for engineering LLM products
Stars
3,191Last commit
14 hours agoLicense
Apache-2.0
Laminar is an open-source platform that helps collect, understand, and utilize data for building high-quality LLM applications.
Open Source Alternative to:
Capture – Capture screenshots, generate PDFs, scrape content, extract metadata, and automate browsers with one API.
Openlane