Transformer Engine

A library for accelerating Transformer model training on NVIDIA GPUs.