LLM API management & key redistribution system for various AI models, supporting unified API access and easy deployment.
FlowDown is a fast client app for AI/LLM usage with privacy protection and free models included.
易上手的多平台 LLM 聊天机器人及开发框架，支持多种消息平台与大语言模型。
A high-throughput and memory-efficient inference and serving engine for LLMs.
Replace OpenAI GPT with another LLM in your app by changing a single line of code.
SGLang is a fast serving framework for large language models and vision language models.
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
A comprehensive open-source tutorial on large-scale pre-trained language models covering theory and practical applications.
HippoRAG is a novel RAG framework that enables LLMs to integrate knowledge across external documents, inspired by human memory.
An open-source LLM evaluation framework for testing and evaluating large language model outputs.
LLM Arena by KCORES is a benchmarking platform for programming skills using large models.
