Learn More

Open Source Local Model Runners using Lucide Icons

A curated collection of the best open source run and serve large language models locally or on your own infrastructure. using Lucide Icons.

Run LLMs locally with minimal setup, maximum hardware support
  • Stars


    127,995
  • Last commit


    10 hours ago
  • License


    MIT
C/C++ inference engine for large language models, supporting quantization, multi-GPU, Apple Silicon, and an OpenAI-compatible server across a wide range of hardware.

Open Source Alternative to:

Favicon of Jan

Jan

AI
Run AI models locally or connect to cloud, privately
  • Stars


    44,441
  • Last commit


    2 days ago
  • License


    Apache-2.0
Jan runs open-source AI models on your own hardware or connects to cloud providers like OpenAI, Anthropic, and Google, keeping your conversations off third-party servers.

Open Source Alternative to:

Favicon