Open Source Local Model Runners using Prettier
A curated collection of the best open source run and serve large language models locally or on your own infrastructure. using Prettier.
Run open-source LLMs locally on your own machine
Stars
178,973Last commit
8 hours agoLicense
MIT
Runs open-source language models locally with a simple setup, plus optional cloud access for larger models when local hardware isn't enough.
Open Source Alternative to:
Run LLMs locally with minimal setup, maximum hardware support
Stars
124,707Last commit
6 hours agoLicense
MIT
C/C++ inference engine for large language models, supporting quantization, multi-GPU, Apple Silicon, and an OpenAI-compatible server across a wide range of hardware.
Open Source Alternative to:
Run open-source AI models privately on your own device
Stars
77,404Last commit
1 year agoLicense
MIT
GPT4All runs open-source language models locally on Windows, macOS, and Linux with no cloud dependency, keeping your data on your machine.
Open Source Alternative to:
Run AI models locally or connect to cloud, privately
Stars
44,052Last commit
10 hours agoLicense
Apache-2.0
Jan runs open-source AI models on your own hardware or connects to cloud providers like OpenAI, Anthropic, and Google, keeping your conversations off third-party servers.
Open Source Alternative to:
Docmost – Open-source wiki software with real-time collaboration, diagrams, AI, SSO, RBAC permissions and more.
Sevalla