Submit
Ad
Learn more

Open Source Projects tagged "Local Llm"

A curated collection of the best open source projects tagged "Local Llm". Each listing includes a website screenshot along with a detailed review of its features.

llama.cpp

AI
Run LLMs locally with minimal setup, maximum hardware support

  • Stars

    133,688

  • Last commit

    9 hours ago

  • License

    MIT
C/C++ inference engine for large language models, supporting quantization, multi-GPU, Apple Silicon, and an OpenAI-compatible server across a wide range of hardware.

Open Source Alternative to:

LM Studio

AnythingLLM

AI
Chat with your documents using any LLM, fully private

  • Stars

    68,052

  • Last commit

    2 days ago

  • License

    MIT
A desktop and self-hostable AI app for chatting with documents, running local LLMs, and using AI agents without writing code or creating an account.

Open Source Alternative to:

Claude

nanobot

AI
Self-hosted AI agent for chat, automation, and workflows

  • Stars

    49,917

  • Last commit

    10 hours ago

  • License

    MIT
Lightweight, self-hosted AI agent that runs in a web UI, terminal, or chat app, handling long-running workflows with controlled token budgets.

Open Source Alternative to:

OpenAI Dots

GPT4All

AI
Run open-source AI models privately on your own device

  • Stars

    77,343

  • Last commit

    1 year ago

  • License

    MIT
GPT4All runs open-source language models locally on Windows, macOS, and Linux with no cloud dependency, keeping your data on your machine.

Open Source Alternative to:

LM Studio

Qwen Code

AI
Open source AI coding agent for the terminal and IDE

  • Stars

    29,081

  • Last commit

    8 hours ago

  • License

    Apache-2.0
Terminal-based AI coding agent that reads your codebase, edits files and runs commands, with support for Qwen, OpenAI, Anthropic, Gemini and local models.

Open Source Alternative to:

Claude Code

Dograh

AI
Self-hostable voice agent platform with full model control

  • Stars

    Stars growing over the last 30 days6,038

  • Last commit

    1 day ago

  • License

    BSD-2-Clause
Open-source voice agent platform that lets you plug in your own STT, LLM, and TTS models, deploy on-prem or in your VPC, and build agents via MCP or a visual workflow builder.

Open Source Alternative to:

Voiceflow

Deta Surf

Browser and notebook combined with local-first AI

  • Stars

    3,634

  • Last commit

    3 months ago

  • License

    Apache-2.0
A browser that doubles as a personal notebook, letting you research, summarize, and take notes on web pages, PDFs, and videos without switching apps.

Open Source Alternative to:

NotebookLM
Ad