Open Source Local Model Runners using OpenAI
A curated collection of the best open source run and serve large language models locally or on your own infrastructure. using OpenAI.
High-throughput, memory-efficient serving engine for LLMs
Stars
93,122Last commit
8 hours agoLicense
Apache-2.0
Inference and serving engine for large language models, built for speed and hardware efficiency with an OpenAI-compatible API and support for a wide range of open models.
Open Source Alternative to:
Docmost – Open-source wiki software with real-time collaboration, diagrams, AI, SSO, RBAC permissions and more.
Docmost