SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 16+ clouds) with unified execution and cost savings.
A high-throughput and memory-efficient inference and serving engine for LLMs.
Replace OpenAI GPT with another LLM in your app by changing a single line of code.
:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first.
SGLang is a fast serving framework for large language models and vision language models.
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
Production-tested AI infrastructure tools for efficient AGI development and community-driven innovation.
R1-Onevision is a visual language model capable of deep CoT reasoning.
Tiny data-over-sound library for communicating small amounts of data between air-gapped devices using sound.
A user-friendly file upload tool optimized for multi-file and large file handling to easily upload files to Cloudflare R2 storage.
A tool for real-time editing and submission of live broadcasts on bilibili and Douyin.
A comprehensive open-source tutorial on large-scale pre-trained language models covering theory and practical applications.
