Top 9 distillation open source projects

Neural Network Distiller by Intel AI Lab: a Python package for neural network compression research. https://intellabs.github.io/distiller

Yolov5 distillation training | Yolov5知识蒸馏训练，支持训练自己的数据

A Fast Knowledge Distillation Framework for Visual Recognition

SimpleAICV:pytorch training example on ImageNet(ILSVRC2012)/COCO2017/VOC2007+2012 datasets.Include ResNet/DarkNet/RetinaNet/FCOS/CenterNet/TTFNet/YOLOv3/YOLOv4/YOLOv5/YOLOX.

🛠️ Tools for Transformers compression using PyTorch Lightning ⚡

this is roberta wwm base distilled model which was distilled from roberta wwm by roberta wwm large

PyTorch Implementation on Paper [CVPR2021]Distilling Audio-Visual Knowledge by Compositional Contrastive Learning

Adaptive, interpretable wavelets across domains (NeurIPS 2021)

CVPR 2021 : Zero-shot Adversarial Quantization (ZAQ)