Ad
Learn more

Open Source Local Model Runners using Golang

A curated collection of the best open source run and serve large language models locally or on your own infrastructure. using Golang.

Run open-source LLMs locally on your own machine
  • Stars

    185,701
  • Last commit

    10 hours ago
  • License

    MIT
Runs open-source language models locally with a simple setup, plus optional cloud access for larger models when local hardware isn't enough.

Open Source Alternative to:

Self-hosted AI runtime for text, voice, vision, and agents
  • Stars

    50,139
  • Last commit

    9 hours ago
  • License

    MIT
Run LLMs, speech, image generation, and autonomous agents on your own hardware with an OpenAI-compatible API and 60+ swappable backends.

Open Source Alternative to: