Ollama

Run open-source LLMs locally with a simple CLI and API server.

Ollama makes it easy to download and run open-source LLMs locally across macOS, Linux, and Windows, exposing a simple CLI and an OpenAI-compatible local API. It handles model packaging, quantization, and GPU/CPU execution, and is widely used for local development and privacy-sensitive workloads.