nanotron

github.com ↗

Minimalistic large language model 3D-parallelism training.