Local runtime · Desktop runner

exo

Device-mesh inference runtime that connects a user's own computers into a cluster, splitting models across devices by pipeline or tensor sharding and serving them through OpenAI-, Claude-, Ollama-, and Responses-compatible APIs behind a web dashboard.

Maintainer

exo labs

Accelerators

CPU · Apple Metal · Multi-GPU

Model formats

MLX

Source model

Open source

Licenses

Apache License 2.0

Boundary

Represents the exo-explore/exo software maintained by exo labs. It is not MLX or MLX distributed, the Apple inference backend and communication layer it builds on and names in its README, and not the Hugging Face hub models it downloads, which are MLX conversions such as the mlx-community checkpoints in its examples. It is not Ollama, though it serves an Ollama-compatible API path, and not a managed cloud service. Because the product exists to run models on the user's own hardware and its dashboard chat is how that capability is exercised, it classifies as a runtime rather than an assistant under ADR 015. The record is distinct from the published Exo Harness project, an unrelated agent runtime that shares only the name.

Open in the directory → Open official documentation ↗

Editorial ratings appear in the directory beside the profile they belong to and are never compared across collections.