Directory · Local LLM
Ollama
Local LLM runtime. Pull models, run them on your laptop, expose an OpenAI-compatible API.
Best for
Privacy-sensitive tasks, offline use, embedded LLM workflows
Pros and cons
Pros
- Free
- Local-first
- Wide model support
Cons
- GPU strongly recommended
- Slower than hosted APIs
- Quality < frontier models
Alternatives
More local llm tools
GPT4All
Local LLM · Nomic AI · United States
Nomic's open-source desktop app for running local LLMs on consumer hardware, with local file chat via LocalDocs.
Best for
Chatting with local models and documents on everyday laptops
Jan
Local LLM · Menlo Research
Open-source ChatGPT-style desktop app that runs models locally via llama.cpp, with an offline-first design.
Best for
A private, open-source local chat app with optional cloud model connections
llama.cpp
Local LLM · ggml.ai
C/C++ inference engine for running quantized LLMs in GGUF format efficiently on CPUs and GPUs across platforms.
Best for
Maximum-efficiency local inference and embedding into other software