Open Source Projects tagged "Local Llm"
A curated collection of the best open source projects tagged "Local Llm". Each listing includes a website screenshot along with a detailed review of its features.
Run LLMs locally with minimal setup, maximum hardware support
Stars
131,662Last commit
7 hours agoLicense
MIT
C/C++ inference engine for large language models, supporting quantization, multi-GPU, Apple Silicon, and an OpenAI-compatible server across a wide range of hardware.
Open Source Alternative to:
Chat with your documents using any LLM, fully private
Stars
67,299Last commit
3 days agoLicense
MIT
A desktop and self-hostable AI app for chatting with documents, running local LLMs, and using AI agents without writing code or creating an account.
Open Source Alternative to:
Self-hosted AI agent for chat, automation, and workflows
Stars
49,166Last commit
7 hours agoLicense
MIT
Lightweight, self-hosted AI agent that runs in a web UI, terminal, or chat app, handling long-running workflows with controlled token budgets.
Open Source Alternative to:
Run open-source AI models privately on your own device
Stars
77,350Last commit
1 year agoLicense
MIT
GPT4All runs open-source language models locally on Windows, macOS, and Linux with no cloud dependency, keeping your data on your machine.
Open Source Alternative to:
Open source AI coding agent for the terminal and IDE
Stars
28,571Last commit
7 hours agoLicense
Apache-2.0
Terminal-based AI coding agent that reads your codebase, edits files and runs commands, with support for Qwen, OpenAI, Anthropic, Gemini and local models.
Open Source Alternative to:
Self-hostable voice agent platform with full model control
Stars
5,904Last commit
9 hours agoLicense
BSD-2-Clause
Open-source voice agent platform that lets you plug in your own STT, LLM, and TTS models, deploy on-prem or in your VPC, and build agents via MCP or a visual workflow builder.
Open Source Alternative to:
Browser and notebook combined with local-first AI
Stars
3,603Last commit
2 months agoLicense
Apache-2.0
A browser that doubles as a personal notebook, letting you research, summarize, and take notes on web pages, PDFs, and videos without switching apps.
Open Source Alternative to:
Openlane – Open-source, developer-first platform for automated compliance, risk management, and built-in Trust Center.
Docmost