Open Source AI Gateways using Cohere AI
A curated collection of the best open source platforms that route and secure API access to multiple AI models through one unified interface, with authentication, rate limiting, and usage monitoring. using Cohere AI.
LLM gateway for auth, load balancing, and spend tracking
Stars
58,047Last commit
5 hours agoLicense
Unknown
Acts as a unified proxy across 100+ LLMs, normalizing them to the OpenAI format while handling virtual keys, budgets, rate limits, fallbacks, and cost tracking.
Open Source Alternative to:
Route GenAI traffic with confidence using open source
Stars
1,998Last commit
7 hours agoLicense
Apache-2.0
Open source gateway built on Envoy for routing application traffic to GenAI services. Supports 16+ LLM providers including OpenAI, Anthropic, AWS Bedrock.
Open Source Alternative to:
Sent – Messaging Infrastructure for Developers. One API for SMS, WhatsApp, and RCS across 190+ countries.
Sent