exo Project Repository

The exo project allows users to run their own AI cluster with everyday devices like smartphones, laptops, and home computers. It supports popular models like LLaMA and offers wide model support with dynamic model partitioning, automatic device discovery, and a ChatGPT-compatible API. An experimental project, it's open for community contributions and bug reports.

Visit Original Article →