Ollama
Run open models like Llama, Qwen and DeepSeek locally with one command.
About
Ollama downloads, runs and serves open-weight models on your own machine. It exposes a local API that many tools can use, so you can work offline and keep data private. The standard backend of the local-AI ecosystem.
# Download the installer from https://ollama.com, then:
ollama pull llama3.1
ollama run llama3.1
# GGUF files (e.g. Muse Glimmer 30B): download the .gguf,
# create a Modelfile with: FROM ./Muse-Glimmer-30B-GGUF.gguf
ollama create muse-glimmer -f Modelfile
ollama run muse-glimmerCopy individual commands
- Download the installer from https://ollama.com, then::
ollama pull llama3.1 ollama run llama3.1- create a Modelfile with: FROM ./Muse-Glimmer-30B-GGUF.gguf:
ollama create muse-glimmer -f Modelfile ollama run muse-glimmer
More in Local & Free AI
View all
AnythingLLM
Private, local-first app to chat with your documents and run AI agents
Local & Free AIOpen sourceActive68.1K
Colibri
Frontier MoE models on hardware you already own — pure C, zero dependencies.
git clone https://github.com/JustVugg/colibri
Local & Free AIOpen sourceActive49.1K
Jan
A ChatGPT-style app that runs 100% offline on your computer.
Local & Free AIOpen sourceActive45.6K