AnythingLLM
Private, local-first app to chat with your documents and run AI agents
About
AnythingLLM is an open-source, local-first AI application for chatting with your own documents using retrieval-augmented generation (RAG). It bundles built-in agents, multi-user support (Docker version), embeddable chat widgets, and a developer API, and works with local models or 30+ cloud providers, many embedders, and vector databases like LanceDB, Chroma, and Pinecone. It is best for individuals and teams who want a private ChatGPT-style workspace over their own files without sending data to a third-party service.
# Easiest: download the desktop app (macOS, Windows, Linux) from https://anythingllm.com
# Or self-host with Docker (multi-user):
export STORAGE_LOCATION=$HOME/anythingllm && \
mkdir -p $STORAGE_LOCATION && \
touch "$STORAGE_LOCATION/.env" && \
docker run -d -p 3001:3001 \
--cap-add SYS_ADMIN \
-v ${STORAGE_LOCATION}:/app/server/storage \
-v ${STORAGE_LOCATION}/.env:/app/server/.env \
-e STORAGE_DIR="/app/server/storage" \
mintplexlabs/anythingllmThe Docker version serves the app at http://localhost:3001. No model account is required to start — AnythingLLM can run local models on your own hardware, or you can plug in a provider API key in settings.
More in Local & Free AI
View all
Ollama
Run open models like Llama, Qwen and DeepSeek locally with one command.
Colibri
Frontier MoE models on hardware you already own — pure C, zero dependencies.
Jan
A ChatGPT-style app that runs 100% offline on your computer.