Ad
 
Learn More

Open Source Local Model Runners using Golang

A curated collection of the best open source run and serve large language models locally or on your own infrastructure. using Golang.

Run open-source LLMs locally on your own machine
  • Stars


    180,064
  • Last commit


    4 hours ago
  • License


    MIT
Runs open-source language models locally with a simple setup, plus optional cloud access for larger models when local hardware isn't enough.

Open Source Alternative to:

Self-hosted AI runtime for text, voice, vision, and agents
  • Stars


    48,846
  • Last commit


    51 minutes ago
  • License


    MIT
Run LLMs, speech, image generation, and autonomous agents on your own hardware with an OpenAI-compatible API and 60+ swappable backends.

Open Source Alternative to:

Favicon