Skip to content

Local LLMs

AIlocalllmai

Tools to run an LLM locally — from one-command installs to full offline chat apps.

ProjectDescriptionURL
OllamaRun Llama, Mistral, Gemma and 50+ models locally. One command to install.https://github.com/ollama/ollama
LM StudioDesktop app that downloads and runs any open model with zero code.https://lmstudio.ai
JanOpen-source ChatGPT alternative that runs 100% offline.https://github.com/menloresearch/jan
GPT4AllBeginner-friendly: download, pick a model, start chatting.https://github.com/nomic-ai/gpt4all
AnythingLLMTurns your local AI into a knowledge base over your own docs.https://github.com/Mintplex-Labs/anything-llm
LocalAIDrop-in replacement for the OpenAI API, pointed at your own machine.https://github.com/mudler/LocalAI
MstyPrivacy-first AI desktop app with multi-model chat and documents.https://msty.app
Open WebUIBrowser-based ChatGPT-style interface for Ollama, fully offline.https://github.com/open-webui/open-webui
llamafileSingle executable that runs a full AI model.https://github.com/Mozilla-Ocho/llamafile