sglang

by sgl-project · AI

SGLang is a high-performance serving framework for large language models and multimodal models.

New0 ratings35,535 starsActive
AIAI ApplicationPythonRust
Open project ↗↓ Download v0.5.19GitHub⚑ Report
sglang preview

About this project

🌐 Website Blog Documentation Roadmap Join Slack Weekly Dev Meeting Slides News — [2026/07] 🔥 SGLang and Miles add day-0 support for Kimi K3 (blog). — [2026/07] RadixArk and Google bring full SGLang features to TPUs (blog). — [2026/07] Serving GLM5.2 NVFP4 agentic workloads with SGLang: Reaching 500 TPS in two weeks (blog). — [2026/06] 🔥 The next generation of speculative decoding: DFlash and Spec V2 (blog). — [2026/06] SGLang provides day-0 support for latest open models (Nemotron 3 Ultra, Nemotron 3 Super, Higgs Audio v3 TTS). — [2026/04] 🔥 DeepSeek-V4 on Day 0: From Fast Inference to Verified RL with SGLang and Miles (blog). — [2026/02] 🔥 Unlocking 25x Inference…

Technologies

ShellPythonC++RustCudablackwellattention

Project health

Actively maintained
Last update2 days ago
Contributors450
Latest releasev0.5.19
Open issues & PRs5,142
LicenseApache-2.0
On GitHubsince 2024

GitHub

35,535
stars
8,597
forks
450
contributors
5,142
open issues & PRs
Python
language
2 days ago
last commit
View on GitHub ↗All releases ↗

Reviews

out of 5 · 0 ratings
★★★★★
0%
★★★★
0%
★★★
0%
★★
0%
0%
Sign in to write a review
No reviews yet
Be the first to review sglang.

Built by

sgl-project
Imported from GitHub · not yet claimed on GitPalace
View developer pageSign in with GitHub to claim

Maintain sgl-project/sglang? Claiming verifies admin access through your GitHub account and gives you control of this listing.

You might also like