sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
About this project
🌐 Website Blog Documentation Roadmap Join Slack Weekly Dev Meeting Slides News — [2026/07] 🔥 SGLang and Miles add day-0 support for Kimi K3 (blog). — [2026/07] RadixArk and Google bring full SGLang features to TPUs (blog). — [2026/07] Serving GLM5.2 NVFP4 agentic workloads with SGLang: Reaching 500 TPS in two weeks (blog). — [2026/06] 🔥 The next generation of speculative decoding: DFlash and Spec V2 (blog). — [2026/06] SGLang provides day-0 support for latest open models (Nemotron 3 Ultra, Nemotron 3 Super, Higgs Audio v3 TTS). — [2026/04] 🔥 DeepSeek-V4 on Day 0: From Fast Inference to Verified RL with SGLang and Miles (blog). — [2026/02] 🔥 Unlocking 25x Inference…
Technologies
Project health
GitHub
Reviews
Built by
Maintain sgl-project/sglang? Claiming verifies admin access through your GitHub account and gives you control of this listing.
