torchtitan

About this project

torchtitan A PyTorch native platform for training generative AI models torchtitan is under extensive development. To use the latest features of torchtitan, we recommend using the most recent PyTorch nightly. Latest News — [2026/08] TitanRL is a hackable RL stack for scaling and debugging. It reuses TorchTitan model definitions and kernels across training and vLLM generation and supports batch-invariant mode. — [2025/11] AMD released an optimized fork of torchtitan for AMD GPUs. — [2025/10] We released torchtitan v0.2.0. — [2025/10] SkyPilot now supports torchtitan! See the tutorial here. — [2025/07] We published instructions on how to add a model to torchtitan. —…

GitHub

Reviews

Built by

pytorch

Imported from GitHub · not yet claimed on GitPalace

View developer pageSign in with GitHub to claim

Maintain pytorch/torchtitan? Claiming verifies admin access through your GitHub account and gives you control of this listing.

You might also like

build-your-own-x

Developer Tools

Master programming by recreating your favorite technologies from scratch.

★ New545.6K stars

by codecrafters-io

awesome

Developer Tools

😎 Awesome lists about all kinds of interesting topics [NOTE: Pull requests are temporarily disabled until I have a chan

★ New503.7K stars

by sindresorhus

public-apis

Developer Tools

A collective list of free APIs

★ New476.5K stars

by public-apis

free-programming-books

Developer Tools

:books: Freely available programming books

★ New396.1K stars

by EbookFoundation