Open Source LLM Observability & Evaluation using npm
A curated collection of the best open source tracing, monitoring, and evaluation platforms for LLM and AI-agent applications. using npm.
Open source LLM engineering platform for AI-powered applications
Stars
33,496Last commit
3 hours agoLicense
MIT
Langfuse provides tracing, evaluations, prompt management, and analytics to debug and improve LLM applications.
Open Source Alternative to:
Monitor LLM performance with open-source observability
Stars
7,387Last commit
11 days agoLicense
Apache-2.0
Open-source observability platform for LLMs using OpenTelemetry. Monitor performance, track costs, and debug AI applications with just 2 lines of code.
Open Source Alternative to:
Build reliable AI apps with comprehensive observability
Stars
6,091Last commit
5 days agoLicense
Apache-2.0
Open-source platform for logging, monitoring, and debugging LLM applications. Route, debug, and analyze AI apps with comprehensive observability tools.
Open Source Alternative to:
Build reliable LLM apps with integrated workflows
Stars
4,504Last commit
9 hours agoLicense
MIT
Open-source LLMOps platform providing prompt management, evaluation, and observability tools for building robust AI applications with team collaboration.
Open Source Alternative to:
Monitor, debug, and scale LLM applications with ease
Stars
2,708Last commit
1 day agoLicense
Apache-2.0
Open-source observability platform for GenAI and LLM applications. Real-time monitoring, distributed tracing, prompt management, and AI model evaluation built on OpenTelemetry.
Open Source Alternative to:
Experiment tracking platform for ML teams
Stars
392Last commit
6 months agoLicense
Apache-2.0
Open source ML experiment tracking platform with parameter and gradient logging, media tracking, real-time alerts, and full Weights & Biases API compatibility.
Open Source Alternative to:
Sent – Messaging Infrastructure for Developers. One API for SMS, WhatsApp, and RCS across 190+ countries.
c15t