Open Source Projects tagged "Llmops"
A curated collection of the best open source projects tagged "Llmops". Each listing includes a website screenshot along with a detailed review of its features.
LLM gateway for auth, load balancing, and spend tracking
Stars
57,075Last commit
16 hours agoLicense
Unknown
Acts as a unified proxy across 100+ LLMs, normalizing them to the OpenAI format while handling virtual keys, budgets, rate limits, fallbacks, and cost tracking.
Open Source Alternative to:
Open source LLM engineering platform for AI-powered applications
Stars
33,579Last commit
11 hours agoLicense
MIT
Langfuse provides tracing, evaluations, prompt management, and analytics to debug and improve LLM applications.
Open Source Alternative to:
Complete production stack for AI teams
Stars
12,806Last commit
3 months agoLicense
MIT
Comprehensive AI platform with gateway, observability, guardrails, and prompt management. Access 1,600+ LLMs via unified API with enterprise-grade security.
Open Source Alternative to:
Open-source LLM tracing & evaluation for AI optimization
Stars
11,149Last commit
8 hours agoLicense
Elastic-2.0
Open-source platform for LLM tracing, evaluation, and optimization. Features automatic instrumentation, prompt playground, and real-time AI application monitoring.
Open Source Alternative to:
Ultra-fast AI gateway with enterprise-grade reliability
Stars
7,521Last commit
10 hours agoLicense
Apache-2.0
Open-source AI gateway delivering 50x faster performance than alternatives. Access 1000+ models from 8+ providers with built-in governance, fallback, and observability.
Open Source Alternative to:
Monitor LLM performance with open-source observability
Stars
7,392Last commit
14 days agoLicense
Apache-2.0
Open-source observability platform for LLMs using OpenTelemetry. Monitor performance, track costs, and debug AI applications with just 2 lines of code.
Open Source Alternative to:
Build reliable AI apps with comprehensive observability
Stars
6,095Last commit
9 hours agoLicense
Apache-2.0
Open-source platform for logging, monitoring, and debugging LLM applications. Route, debug, and analyze AI apps with comprehensive observability tools.
Open Source Alternative to:
Build reliable LLM apps with integrated workflows
Stars
4,519Last commit
8 hours agoLicense
MIT
Open-source LLMOps platform providing prompt management, evaluation, and observability tools for building robust AI applications with team collaboration.
Open Source Alternative to:
AI-powered platform for engineering LLM products
Stars
3,187Last commit
2 days agoLicense
Apache-2.0
Laminar is an open-source platform that helps collect, understand, and utilize data for building high-quality LLM applications.
Open Source Alternative to:
Monitor, debug, and scale LLM applications with ease
Stars
2,714Last commit
4 days agoLicense
Apache-2.0
Open-source observability platform for GenAI and LLM applications. Real-time monitoring, distributed tracing, prompt management, and AI model evaluation built on OpenTelemetry.
Open Source Alternative to:
LLM observability: cost, latency, and traces in one place
Stars
12Last commit
3 days agoLicense
MIT
Drop-in observability platform for OpenAI, Anthropic, and Gemini that logs every request, tracks costs, traces agent workflows, and flags anomalies and PII.
Open Source Alternative to:
Trace, evaluate, and protect every LLM call in one SDK
Stars
7Last commit
2 months agoLicense
AGPL-3.0
An AI gateway that sits on the request path to handle PII redaction, prompt injection blocking, tracing, evals, and cost tracking for OpenAI, Anthropic, and Gemini.
Open Source Alternative to:
Stellar Hosted – Managed Open Source software hosting in the EU: secure, compliant, fast.
InfluxDB