A curated collection of the best open source platforms that manage, secure, and optimize API access to multiple AI models and services through unified interfaces with authentication, rate limiting, and monitoring capabilities. using Sentry.
LLM gateway for auth, load balancing, and spend tracking
Stars
54,249
Forks
9,943
Last commit
36 minutes ago
Acts as a unified proxy across 100+ LLMs, normalizing them to the OpenAI format while handling virtual keys, budgets, rate limits, fallbacks, and cost tracking.