accelerate
🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic m
About this project
Run your raw PyTorch training script on any kind of device Easy to integrate 🤗 Accelerate was created for PyTorch users who like to write the training loop of PyTorch models but are reluctant to write and maintain the boilerplate code needed to use multi-GPUs/TPU/fp16. 🤗 Accelerate abstracts exactly and only the boilerplate code related to multi-GPUs/TPU/fp16 and leaves the rest of your code unchanged. Here is an example: As you can see in this example, by adding 5-lines to any standard PyTorch training script you can now run on any kind of single or distributed node setting (single CPU, single GPU, multi-GPUs and TPUs) as well as with or without mixed precision (fp8,…
Technologies
Project health
GitHub
Reviews
Built by
Maintain huggingface/accelerate? Claiming verifies admin access through your GitHub account and gives you control of this listing.
