Open Source Local Model Runners using SCSS
A curated collection of the best open source run and serve large language models locally or on your own infrastructure. using SCSS.
Run LLMs locally with minimal setup, maximum hardware support
Stars
125,072Last commit
11 hours agoLicense
MIT
C/C++ inference engine for large language models, supporting quantization, multi-GPU, Apple Silicon, and an OpenAI-compatible server across a wide range of hardware.
Open Source Alternative to:
Run AI models locally or connect to cloud, privately
Stars
44,094Last commit
1 day agoLicense
Apache-2.0
Jan runs open-source AI models on your own hardware or connects to cloud providers like OpenAI, Anthropic, and Google, keeping your conversations off third-party servers.
Open Source Alternative to:
Openlane – Open-source, developer-first platform for automated compliance, risk management, and built-in Trust Center.
Capture