LLM gateway for auth, load balancing, and spend tracking
Stars
50,292
Forks
8,862
Last commit
8 hours ago
Acts as a unified proxy across 100+ LLMs, normalizing them to the OpenAI format while handling virtual keys, budgets, rate limits, fallbacks, and cost tracking.
Open-source LLM tracing & evaluation for AI optimization
Stars
10,127
Forks
921
Last commit
11 hours ago
Open-source platform for LLM tracing, evaluation, and optimization. Features automatic instrumentation, prompt playground, and real-time AI application monitoring.