Open Source LLM Observability & Evaluation using NodeJS
A curated collection of the best open source tracing, monitoring, and evaluation platforms for LLM and AI-agent applications. using NodeJS.
Open source LLM engineering platform for AI-powered applications
Stars
Stars growing over the last 30 days36,814Last commit
19 hours agoLicense
MIT
Langfuse provides tracing, evaluations, prompt management, and analytics to debug and improve LLM applications.
Open Source Alternative to:
Open-source LLM tracing & evaluation for AI optimization
Stars
Stars growing over the last 30 days12,087Last commit
17 hours agoLicense
Elastic-2.0
Open-source platform for LLM tracing, evaluation, and optimization. Features automatic instrumentation, prompt playground, and real-time AI application monitoring.
Open Source Alternative to:
Monitor LLM performance with open-source observability
Stars
7,514Last commit
13 days agoLicense
Apache-2.0
Open-source observability platform for LLMs using OpenTelemetry. Monitor performance, track costs, and debug AI applications with just 2 lines of code.
Open Source Alternative to:
Build reliable AI apps with comprehensive observability
Stars
6,249Last commit
4 days agoLicense
Apache-2.0
Open-source platform for logging, monitoring, and debugging LLM applications. Route, debug, and analyze AI apps with comprehensive observability tools.
Open Source Alternative to:
Build, automate, and improve AI agents with your team
Stars
4,879Last commit
9 hours agoLicense
MIT
Open-source workspace for building and running AI agents: chat-driven development, scheduling, human-in-the-loop approvals, versioning, and tracing. Self-host or use the cloud.
Open Source Alternative to:
Simulation-based testing and evaluation for AI agents
Stars
5,002Last commit
9 hours agoLicense
Apache-2.0
Tests AI agents through multi-turn simulations, LLM-based scoring, and production tracing so teams can ship reliable agents with confidence.
Open Source Alternative to:
Full observability for AI agents in production
Stars
4,741Last commit
4 days agoLicense
MIT
Open-source platform for monitoring AI agents: captures traces, surfaces failure patterns, alerts on issues, and helps you verify fixes with automated evals.
Open Source Alternative to:
AI-powered platform for engineering LLM products
Stars
Stars growing over the last 30 days3,465Last commit
1 day agoLicense
Apache-2.0
Laminar is an open-source platform that helps collect, understand, and utilize data for building high-quality LLM applications.
Open Source Alternative to:
Monitor, debug, and scale LLM applications with ease
Stars
2,895Last commit
2 days agoLicense
Apache-2.0
Open-source observability platform for GenAI and LLM applications. Real-time monitoring, distributed tracing, prompt management, and AI model evaluation built on OpenTelemetry.
Open Source Alternative to:
Experiment tracking platform for ML teams
Stars
394Last commit
8 months agoLicense
Apache-2.0
Open source ML experiment tracking platform with parameter and gradient logging, media tracking, real-time alerts, and full Weights & Biases API compatibility.
Open Source Alternative to:
LLM observability: cost, latency, and traces in one place
Stars
13Last commit
6 days agoLicense
MIT
Drop-in observability platform for OpenAI, Anthropic, and Gemini that logs every request, tracks costs, traces agent workflows, and flags anomalies and PII.
Open Source Alternative to:
Trace, evaluate, and protect every LLM call in one SDK
Stars
12Last commit
2 months agoLicense
AGPL-3.0
An AI gateway that sits on the request path to handle PII redaction, prompt injection blocking, tracing, evals, and cost tracking for OpenAI, Anthropic, and Gemini.
Open Source Alternative to:
c15t – Open-source cookie banner, built for control and lightening fast modern web apps.
Capture