Local runtime · Embedded library
llama.cpp
Dependency-free C/C++ inference implementation for language and vision-language models, consumed as a library, command-line tool, and bundled OpenAI-compatible server across a wide range of hardware backends.
- Maintainer
- ggml-org
- Accelerators
- CPU · NVIDIA CUDA · AMD ROCm · Apple Metal · Vulkan · SYCL · Multi-GPU
- Model formats
- GGUF
- Source model
- Open source
- Licenses
- MIT License
- Boundary
- Represents the llama.cpp project and the tools it ships. Downstream products that embed it, including Ollama, LM Studio, LocalAI, and Jan, are separate boundaries and are not represented by this record.
Open in the directory → Open official documentation ↗
Editorial ratings appear in the directory beside the profile they belong to and are never compared across collections.