accelerate

github.com ↗

A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-precision