
SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 16+ clouds) with unified execution and cost savings.

A high-throughput and memory-efficient inference and serving engine for LLMs.

Replace OpenAI GPT with another LLM in your app by changing a single line of code.

:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first.

SGLang is a fast serving framework for large language models and vision language models.

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Production-tested AI infrastructure tools for efficient AGI development and community-driven innovation.

Tiny data-over-sound library for communicating small amounts of data between air-gapped devices using sound.

A high-performance distributed file system designed for AI training and inference workloads.

Agent Zero is a customizable AI framework that learns and grows with you.

Fast Open-Source Search & Clustering engine for Vectors & Strings across multiple programming languages.