LLM gateway for auth, load balancing, and spend tracking
Stars
50,750
Forks
8,970
Last commit
6 hours ago
Acts as a unified proxy across 100+ LLMs, normalizing them to the OpenAI format while handling virtual keys, budgets, rate limits, fallbacks, and cost tracking.