Ad
Learn more

Open Source Local Model Runners using Lucide Icons

A curated collection of the best open source run and serve large language models locally or on your own infrastructure. using Lucide Icons.

Run LLMs locally with minimal setup, maximum hardware support
  • Stars

    132,150
  • Last commit

    9 hours ago
  • License

    MIT
C/C++ inference engine for large language models, supporting quantization, multi-GPU, Apple Silicon, and an OpenAI-compatible server across a wide range of hardware.

Open Source Alternative to:

Jan

AI
Run AI models locally or connect to cloud, privately
  • Stars

    45,049
  • Last commit

    9 hours ago
  • License

    Apache-2.0
Jan runs open-source AI models on your own hardware or connects to cloud providers like OpenAI, Anthropic, and Google, keeping your conversations off third-party servers.

Open Source Alternative to: