Submit
Ad
Learn more

Open Source LLM Observability & Evaluation using npm

A curated collection of the best open source tracing, monitoring, and evaluation platforms for LLM and AI-agent applications. using npm.

Langfuse

AI
Open source LLM engineering platform for AI-powered applications

  • Stars

    Stars growing over the last 30 days36,095

  • Last commit

    4 hours ago

  • License

    MIT
Langfuse provides tracing, evaluations, prompt management, and analytics to debug and improve LLM applications.

Open Source Alternative to:

LangSmith

OpenLLMetry

AI
Monitor LLM performance with open-source observability

  • Stars

    7,501

  • Last commit

    2 days ago

  • License

    Apache-2.0
Open-source observability platform for LLMs using OpenTelemetry. Monitor performance, track costs, and debug AI applications with just 2 lines of code.

Open Source Alternative to:

DataDog

Helicone

AI
Build reliable AI apps with comprehensive observability

  • Stars

    6,228

  • Last commit

    17 hours ago

  • License

    Apache-2.0
Open-source platform for logging, monitoring, and debugging LLM applications. Route, debug, and analyze AI apps with comprehensive observability tools.

Open Source Alternative to:

DataDog

Agenta

AI
Build, automate, and improve AI agents with your team

  • Stars

    4,848

  • Last commit

    3 hours ago

  • License

    MIT
Open-source workspace for building and running AI agents: chat-driven development, scheduling, human-in-the-loop approvals, versioning, and tracing. Self-host or use the cloud.

Open Source Alternative to:

Claude Cowork

LangWatch

AI
Simulation-based testing and evaluation for AI agents

  • Stars

    4,982

  • Last commit

    4 hours ago

  • License

    Apache-2.0
Tests AI agents through multi-turn simulations, LLM-based scoring, and production tracing so teams can ship reliable agents with confidence.

Open Source Alternative to:

LangSmith

OpenLIT

AI
Monitor, debug, and scale LLM applications with ease

  • Stars

    Stars growing over the last 30 days2,865

  • Last commit

    11 hours ago

  • License

    Apache-2.0
Open-source observability platform for GenAI and LLM applications. Real-time monitoring, distributed tracing, prompt management, and AI model evaluation built on OpenTelemetry.

Open Source Alternative to:

LangSmith

mlop

AI
Experiment tracking platform for ML teams

  • Stars

    393

  • Last commit

    8 months ago

  • License

    Apache-2.0
Open source ML experiment tracking platform with parameter and gradient logging, media tracking, real-time alerts, and full Weights & Biases API compatibility.

Open Source Alternative to:

Weights and Biases
Ad