Ollama

About

Ollama makes it easy to run large language models on your local machine. Supports DeepSeek, Llama 3, Qwen, Gemma and dozens of models. Provides a REST API for integration with any app. Fully offline, data never leaves your machine.