LM Studio

LM Studio is the cross-platform desktop application for downloading, running, and serving local LLMs (Llama, Gemma, Qwen) on macOS, Windows, and Linux.

LM Studio delivers local LLM power directly to your desktop (macOS, Windows, Linux). Use the built-in catalog to discover and download models like Llama 3.1 or Gemma 2 in formats like GGUF and MLX. Run these models offline via a simple chat interface, or expose them over an OpenAI-compatible REST API for seamless integration with your development projects. This is local, private AI: full control, zero cloud dependency.

https://lmstudio.ai/