A curated collection of the best open source platforms that manage, secure, and optimize API access to multiple AI models and services through unified interfaces with authentication, rate limiting, and monitoring capabilities. using Cohere AI.
LLM gateway for auth, load balancing, and spend tracking
Stars
50,519
Forks
8,906
Last commit
29 minutes ago
Acts as a unified proxy across 100+ LLMs, normalizing them to the OpenAI format while handling virtual keys, budgets, rate limits, fallbacks, and cost tracking.
Route GenAI traffic with confidence using open source
Stars
1,754
Forks
275
Last commit
2 days ago
Open source gateway built on Envoy for routing application traffic to GenAI services. Supports 16+ LLM providers including OpenAI, Anthropic, AWS Bedrock.