Directory · Local LLM
GPT4All
Nomic's open-source desktop app for running local LLMs on consumer hardware, with local file chat via LocalDocs.
Best for
Chatting with local models and documents on everyday laptops
More local llm tools
Jan
Local LLM · Menlo Research
Open-source ChatGPT-style desktop app that runs models locally via llama.cpp, with an offline-first design.
Best for
A private, open-source local chat app with optional cloud model connections
llama.cpp
Local LLM · ggml.ai
C/C++ inference engine for running quantized LLMs in GGUF format efficiently on CPUs and GPUs across platforms.
Best for
Maximum-efficiency local inference and embedding into other software
LM Studio
Local LLM · Element Labs · United States
Free desktop app for discovering, downloading, and running local LLMs with a chat UI and OpenAI-compatible local server.
Best for
Running GGUF and MLX models locally without command-line setup