xtuner
A Next-Generation Training Engine Built for Ultra-Large MoE Models
About this project
👋 join us on 🔍 Explore our models on English 简体中文 🚀 Speed Benchmark 🎉 News — \[2025/09\] XTuner V1 Released! A Next-Generation Training Engine Built for Ultra-Large MoE Models 📖 XTuner V1 XTuner V1 is a next-generation LLM training engine specifically designed for ultra-large-scale MoE models. Unlike traditional 3D parallel training architectures, XTuner V1 is optimized for the mainstream MoE training scenarios prevalent in today's academic research. Key Features 📊 Dropless Training — Scalable without complexity: Train 200B-scale MoE models without expert parallelism; 600B models require only intra-node expert parallelism — Optimized parallelism…
Technologies
Project health
GitHub
Reviews
Built by
Maintain InternLM/xtuner? Claiming verifies admin access through your GitHub account and gives you control of this listing.
