Exo
Exo is an experimental software that enables you to unify your existing devices into a powerful AI cluster at home. It supports various models and allows dynamic model partitioning, automatic device discovery, and provides a ChatGPT-compatible API.
Key Features
- Wide Model Support: Run multiple AI models including LLaMA, Mistral, and Deepseek.
- Dynamic Model Partitioning: Efficiently split models based on device capabilities.
- Automatic Device Discovery: No manual setup is required; devices connect automatically on the network.
- ChatGPT-compatible API: Easily integrate AI capabilities into your applications with minimal configuration.
Benefits
- Run larger models than possible with a single device.
- Utilize everyday devices, including smartphones, laptops, and mini-computers, for AI workloads.
- Contribute to an experimental and collaborative tech community.
Explore the full potential of your devices with Exo and join the community of users advancing the landscape of AI at home.
