Newsletter
Join the Community
Subscribe to our newsletter for the latest news and updates
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
LMDeploy is a powerful toolkit designed for compressing, deploying, and serving Large Language Models (LLMs). Developed by the MMRazor and MMDeploy teams, it offers a range of features that enhance the performance and efficiency of LLMs in various applications.