Local runtime · Compatibility gateway
LocalAI
Self-hosted server presenting compatible text, embedding, image, and audio APIs over interchangeable local inference backends, with a model gallery and a web interface.
- Maintainer
- Ettore Di Giacinto and contributors
- Accelerators
- CPU · NVIDIA CUDA · AMD ROCm · Vulkan · SYCL
- Model formats
- GGUF · Safetensors
- Source model
- Open source
- Licenses
- MIT License
- Boundary
- Represents the self-hosted gateway and the backends it manages, not the individual inference engines it can load and not any hosted service.
Open in the directory → Open official documentation ↗ Repository ↗
Editorial ratings appear in the directory beside the profile they belong to and are never compared across collections.