Local-first model runner for open LLMs, with CLI, API, desktop apps, and optional cloud scaling.
local LLMopen modelsmodel runnerCLIREST APIOpenAI-compatible APIcloud modelsmodel libraryembeddingstool callingvision modelsDocker
Best for:DevOps Engineers
Features
- Pull and run models locally
- CLI and API access
- Desktop app for macOS and Windows
- Access cloud models on demand
- 40,000+ community integrations
- Private, offline operation
Tool Details
Report outdated infoWant tips on using this tool?
