Self-hosted Local Model Runners
A curated collection of the best self-hosted run and serve large language models locally or on your own infrastructure..
Run open-source LLMs locally on your own machine
Stars
184,804Last commit
15 hours agoLicense
MIT
Runs open-source language models locally with a simple setup, plus optional cloud access for larger models when local hardware isn't enough.
Open Source Alternative to:
High-throughput, memory-efficient serving engine for LLMs
Stars
Stars growing over the last 30 days95,549Last commit
11 hours agoLicense
Apache-2.0
Inference and serving engine for large language models, built for speed and hardware efficiency with an OpenAI-compatible API and support for a wide range of open models.
Open Source Alternative to:
Self-hosted AI runtime for text, voice, vision, and agents
Stars
49,964Last commit
11 hours agoLicense
MIT
Run LLMs, speech, image generation, and autonomous agents on your own hardware with an OpenAI-compatible API and 60+ swappable backends.
Open Source Alternative to:
Run AI models locally or connect to cloud, privately
Stars
45,089Last commit
13 hours agoLicense
Apache-2.0
Jan runs open-source AI models on your own hardware or connects to cloud providers like OpenAI, Anthropic, and Google, keeping your conversations off third-party servers.
Open Source Alternative to:
Docmost – Open-source wiki software with real-time collaboration, diagrams, AI, SSO, RBAC permissions and more.
Stellar Hosted