Open Source Local Model Runners using Hugging Face
A curated collection of the best open source run and serve large language models locally or on your own infrastructure. using Hugging Face.
Run LLMs locally with minimal setup, maximum hardware support
Stars
127,051Last commit
5 hours agoLicense
MIT
C/C++ inference engine for large language models, supporting quantization, multi-GPU, Apple Silicon, and an OpenAI-compatible server across a wide range of hardware.
Open Source Alternative to:
Self-hosted AI runtime for text, voice, vision, and agents
Stars
48,862Last commit
10 hours agoLicense
MIT
Run LLMs, speech, image generation, and autonomous agents on your own hardware with an OpenAI-compatible API and 60+ swappable backends.
Open Source Alternative to:
InfluxDB – The purpose-built time series platform for high-velocity ingestion and real-time queries at scale.
Openlane