DeepSpeed

by deepspeedai · Machine Learning

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and eff

New0 ratings43,065 starsActive
Machine LearningAI ApplicationPythonC++
Open project ↗↓ Download v0.19.6GitHub⚑ Report
DeepSpeed preview

About this project

Office Hours DeepSpeed hosts regular office hours on the last Tuesday of each month at 12:00 America/NewYork to discuss development plans, features, etc. This meeting is public for anyone to join and ask questions. The meeting is hosted on Zoom and can be joined here. Latest News [2026/05] Using Muon Optimizer with DeepSpeed [2026/05] System DMA (SDMA) for ZeRO-3: offload collectives off compute units on AMD GPUs for better overlap [2026/03] DeepSpeed Team gave a tutorial at ASPLOS 2026 titled "Building Efficient Large-Scale Model Systems with DeepSpeed: From Open-Source Foundations to Emerging Research" [2026/03] Our SuperOffload work received an Honorable Mention for the ASPLOS…

Technologies

ShellPythonC++CCudabillion-parameterscompressiondata-parallelism

Project health

Actively maintained
Last update2 days ago
Contributors439
Latest releasev0.19.6
Open issues & PRs1,385
LicenseApache-2.0
On GitHubsince 2020

GitHub

43,065
stars
4,963
forks
439
contributors
1,385
open issues & PRs
Python
language
2 days ago
last commit
View on GitHub ↗All releases ↗

Reviews

out of 5 · 0 ratings
★★★★★
0%
★★★★
0%
★★★
0%
★★
0%
0%
Sign in to write a review
No reviews yet
Be the first to review DeepSpeed.

Built by

deepspeedai
Imported from GitHub · not yet claimed on GitPalace
View developer pageSign in with GitHub to claim

Maintain deepspeedai/DeepSpeed? Claiming verifies admin access through your GitHub account and gives you control of this listing.

You might also like