Directory · Local LLM
llama.cpp
C/C++ inference engine for running quantized LLMs in GGUF format efficiently on CPUs and GPUs across platforms.
Best for
Maximum-efficiency local inference and embedding into other software
More local llm tools
GPT4All
Local LLM · Nomic AI · United States
Nomic's open-source desktop app for running local LLMs on consumer hardware, with local file chat via LocalDocs.
Best for
Chatting with local models and documents on everyday laptops
Jan
Local LLM · Menlo Research
Open-source ChatGPT-style desktop app that runs models locally via llama.cpp, with an offline-first design.
Best for
A private, open-source local chat app with optional cloud model connections
LM Studio
Local LLM · Element Labs · United States
Free desktop app for discovering, downloading, and running local LLMs with a chat UI and OpenAI-compatible local server.
Best for
Running GGUF and MLX models locally without command-line setup