xtuner

by InternLM · AI

A Next-Generation Training Engine Built for Ultra-Large MoE Models

New0 ratings5,190 starsActive
AIAI ApplicationPythonShell
Open project ↗↓ Download v0.2.0GitHub⚑ Report
xtuner preview

About this project

👋 join us on 🔍 Explore our models on English 简体中文 🚀 Speed Benchmark 🎉 News — \[2025/09\] XTuner V1 Released! A Next-Generation Training Engine Built for Ultra-Large MoE Models 📖 XTuner V1 XTuner V1 is a next-generation LLM training engine specifically designed for ultra-large-scale MoE models. Unlike traditional 3D parallel training architectures, XTuner V1 is optimized for the mainstream MoE training scenarios prevalent in today's academic research. Key Features 📊 Dropless Training — Scalable without complexity: Train 200B-scale MoE models without expert parallelism; 600B models require only intra-node expert parallelism — Optimized parallelism…

Technologies

ShellPythonDockerfileagentgpt-ossdeepseek-v3

Project health

Actively maintained
Last updateyesterday
Contributors62
Latest releasev0.2.0
Open issues & PRs373
LicenseApache-2.0
On GitHubsince 2023

GitHub

5,190
stars
448
forks
62
contributors
373
open issues & PRs
Python
language
yesterday
last commit
View on GitHub ↗All releases ↗

Reviews

out of 5 · 0 ratings
★★★★★
0%
★★★★
0%
★★★
0%
★★
0%
0%
Sign in to write a review
No reviews yet
Be the first to review xtuner.

Built by

InternLM
Imported from GitHub · not yet claimed on GitPalace
View developer pageSign in with GitHub to claim

Maintain InternLM/xtuner? Claiming verifies admin access through your GitHub account and gives you control of this listing.

You might also like