exo-explore/exo: Run your own AI cluster at home with everyday devices π±π» π₯οΈβ
Run an AI cluster at home using exo, a software that unifies everyday devices into a powerful GPU. It supports LLaMA and other popular models, and uses a peer-to-peer connection without a master-worker architecture. Install it from source with Python>=3.12.0 and access models via a ChatGPT-compatible API endpoint.