Ad
 
Learn More

Open Source Local Model Runners using Tailwind

A curated collection of the best open source run and serve large language models locally or on your own infrastructure. using Tailwind.

Run open-source LLMs locally on your own machine
  • Stars


    178,973
  • Last commit


    7 hours ago
  • License


    MIT
Runs open-source language models locally with a simple setup, plus optional cloud access for larger models when local hardware isn't enough.

Open Source Alternative to:

Run LLMs locally with minimal setup, maximum hardware support
  • Stars


    124,707
  • Last commit


    6 hours ago
  • License


    MIT
C/C++ inference engine for large language models, supporting quantization, multi-GPU, Apple Silicon, and an OpenAI-compatible server across a wide range of hardware.

Open Source Alternative to:

Favicon of Jan

Jan

AI
Run AI models locally or connect to cloud, privately
  • Stars


    44,052
  • Last commit


    10 hours ago
  • License


    Apache-2.0
Jan runs open-source AI models on your own hardware or connects to cloud providers like OpenAI, Anthropic, and Google, keeping your conversations off third-party servers.

Open Source Alternative to:

Favicon