exo

Exo

Exo is an experimental software that enables you to unify your existing devices into a powerful AI cluster at home. It supports various models and allows dynamic model partitioning, automatic device discovery, and provides a ChatGPT-compatible API.

Key Features

• Wide Model Support: Run multiple AI models including LLaMA, Mistral, and Deepseek.
• Dynamic Model Partitioning: Efficiently split models based on device capabilities.
• Automatic Device Discovery: No manual setup is required; devices connect automatically on the network.
• ChatGPT-compatible API: Easily integrate AI capabilities into your applications with minimal configuration.

Benefits

• Run larger models than possible with a single device.
• Utilize everyday devices, including smartphones, laptops, and mini-computers, for AI workloads.
• Contribute to an experimental and collaborative tech community.

Explore the full potential of your devices with Exo and join the community of users advancing the landscape of AI at home.