A curated collection of the best open source platforms that route and secure API access to multiple AI models through one unified interface, with authentication, rate limiting, and usage monitoring. using Prettier.
LLM gateway for auth, load balancing, and spend tracking
Stars
56,760
Last commit
6 hours ago
License
Unknown
Acts as a unified proxy across 100+ LLMs, normalizing them to the OpenAI format while handling virtual keys, budgets, rate limits, fallbacks, and cost tracking.
Comprehensive AI platform with gateway, observability, guardrails, and prompt management. Access 1,600+ LLMs via unified API with enterprise-grade security.
Route GenAI traffic with confidence using open source
Stars
1,940
Last commit
11 hours ago
License
Apache-2.0
Open source gateway built on Envoy for routing application traffic to GenAI services. Supports 16+ LLM providers including OpenAI, Anthropic, AWS Bedrock.
Route, manage, and analyze LLM requests across multiple providers with one API. Compatible with OpenAI format, includes usage analytics and performance monitoring.