Open Source Projects tagged "Local Llm"
A curated collection of the best open source projects tagged "Local Llm". Each listing includes a website screenshot along with a detailed review of its features.
Run LLMs locally with minimal setup, maximum hardware support
Stars
127,518Last commit
12 hours agoLicense
MIT
C/C++ inference engine for large language models, supporting quantization, multi-GPU, Apple Silicon, and an OpenAI-compatible server across a wide range of hardware.
Open Source Alternative to:
Chat with your documents using any LLM, fully private
Stars
65,797Last commit
12 hours agoLicense
MIT
A desktop and self-hostable AI app for chatting with documents, running local LLMs, and using AI agents without writing code or creating an account.
Open Source Alternative to:
Run open-source AI models privately on your own device
Stars
77,382Last commit
1 year agoLicense
MIT
GPT4All runs open-source language models locally on Windows, macOS, and Linux with no cloud dependency, keeping your data on your machine.
Open Source Alternative to:
Self-hostable voice agent platform with full model control
Stars
5,617Last commit
1 day agoLicense
BSD-2-Clause
Open-source voice agent platform that lets you plug in your own STT, LLM, and TTS models, deploy on-prem or in your VPC, and build agents via MCP or a visual workflow builder.
Open Source Alternative to:
Browser and notebook combined with local-first AI
Stars
3,561Last commit
16 days agoLicense
Apache-2.0
A browser that doubles as a personal notebook, letting you research, summarize, and take notes on web pages, PDFs, and videos without switching apps.
Open Source Alternative to:
Sevalla – Deploy your app before your coffee gets cold. It’s that easy. Try Sevalla with $50 free credit.
Docmost