RepDistiller

github.com ↗

Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methods