lmdeploy

About this project

📘Documentation 🛠️Quick Start 🤔Reporting Issues English 简体中文 日本語 👋 join us on Latest News 🎉 2026 — \[2026/08\] Our paper, “LMDeploy Accelerates Mixed-Precision LLM Inference with TurboMind,” has been accepted to EuroSys 2027. — \[2026/04\] PyPI has expanded the storage quota for LMDeploy and wheel uploads have resumed. v0.12.3 is now available on PyPI, so you can install it directly via pip install lmdeploy. — \[2026/02\] Support Qwen3.5 — \[2026/02\] Support vllm-project/llm-compressor 4bit symmetric/asymmetric quantization. Refer here for a detailed guide 2025 — \[2025/09\] TurboMind supports MXFP4 on NVIDIA GPUs starting from V100, achieving 1.5x the…

GitHub

Reviews

Built by

InternLM

Imported from GitHub · not yet claimed on GitPalace

View developer pageSign in with GitHub to claim

Maintain InternLM/lmdeploy? Claiming verifies admin access through your GitHub account and gives you control of this listing.

You might also like

openclaw

AI

The AI that really does things. Any OS. Any Platform. The lobster way. 🦞

★ New389K stars

by openclaw

superpowers

AI

An agentic skills framework & software development methodology that works.

★ New282.4K stars

by obra

hermes-agent

AI

The agent that grows with you

★ New242.5K stars

by NousResearch

n8n

AI

Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host

★ New203.6K stars

by n8n-io