Open Source Local Model Runners using MCP
A curated collection of the best open source run and serve large language models locally or on your own infrastructure. using MCP.
Run LLMs locally with minimal setup, maximum hardware support
Stars
127,051Last commit
5 hours agoLicense
MIT
C/C++ inference engine for large language models, supporting quantization, multi-GPU, Apple Silicon, and an OpenAI-compatible server across a wide range of hardware.
Open Source Alternative to:
Self-hosted AI runtime for text, voice, vision, and agents
Stars
48,862Last commit
10 hours agoLicense
MIT
Run LLMs, speech, image generation, and autonomous agents on your own hardware with an OpenAI-compatible API and 60+ swappable backends.
Open Source Alternative to:
Stellar Hosted – Managed Open Source software hosting in the EU: secure, compliant, fast.
Stellar Hosted