Submit
Ad
Learn more

Open Source Projects tagged "Llm Evaluation"

A curated collection of the best open source projects tagged "Llm Evaluation". Each listing includes a website screenshot along with a detailed review of its features.

Langfuse

AI
Open source LLM engineering platform for AI-powered applications

  • Stars

    Stars growing over the last 30 days36,266

  • Last commit

    7 hours ago

  • License

    MIT
Langfuse provides tracing, evaluations, prompt management, and analytics to debug and improve LLM applications.

Open Source Alternative to:

LangSmith

Arize Phoenix

AI
Open-source LLM tracing & evaluation for AI optimization

  • Stars

    Stars growing over the last 30 days11,970

  • Last commit

    5 hours ago

  • License

    Elastic-2.0
Open-source platform for LLM tracing, evaluation, and optimization. Features automatic instrumentation, prompt playground, and real-time AI application monitoring.

Open Source Alternative to:

LangSmith

Helicone

AI
Build reliable AI apps with comprehensive observability

  • Stars

    6,235

  • Last commit

    4 days ago

  • License

    Apache-2.0
Open-source platform for logging, monitoring, and debugging LLM applications. Route, debug, and analyze AI apps with comprehensive observability tools.

Open Source Alternative to:

DataDog

Agenta

AI
Build, automate, and improve AI agents with your team

  • Stars

    4,856

  • Last commit

    5 hours ago

  • License

    MIT
Open-source workspace for building and running AI agents: chat-driven development, scheduling, human-in-the-loop approvals, versioning, and tracing. Self-host or use the cloud.

Open Source Alternative to:

ChatGPT Work

Laminar

AI
AI-powered platform for engineering LLM products

  • Stars

    Stars growing over the last 30 days3,434

  • Last commit

    6 hours ago

  • License

    Apache-2.0
Laminar is an open-source platform that helps collect, understand, and utilize data for building high-quality LLM applications.

Open Source Alternative to:

LangChain

VerifyWise

AI
AI governance made simple, secure, and compliant

  • Stars

    367

  • Last commit

    8 hours ago

  • License

    AGPL-3.0
Open-source AI governance platform helping teams meet regulatory standards like EU AI Act and ISO 42001. Monitor model performance, manage risks, and maintain compliance with enterprise-grade security.

Open Source Alternative to:

Vanta
Ad