Open Source Local Model Runners using OpenAI
A curated collection of the best open source run and serve large language models locally or on your own infrastructure. using OpenAI.
High-throughput, memory-efficient serving engine for LLMs
Stars
95,239Last commit
9 hours agoLicense
Apache-2.0
Inference and serving engine for large language models, built for speed and hardware efficiency with an OpenAI-compatible API and support for a wide range of open models.
Open Source Alternative to:
InfluxDB – The purpose-built time series platform for high-velocity ingestion and real-time queries at scale.
Sent