TorchDistiller
This project is a collection of the open source pytorch code for knowledge distillation, especially for the perception tasks, including semantic segmentation, depth estimation, object detection and instance segmentation.
Collection papers and codebase
Semantic Segmentation
- Structured Knowledge Distillation for Semantic Segmentation, CVPR2019 [paper] [code]
- Intra-class Feature Variation Distillation for Semantic Segmentation, ECCV2020 [paper] [code]
- Channel-wise Knowledge Distillation for Dense Prediction, ICCV2021 [paper] [code]
- Knowledge Distillation based on MMsegmentation [code]
Object Detection and Instance Segmentation
Update History
- 2021.08.20 Release the code for channel-wise distillation for semantic segmentation
We are integrating more of our work and other great studies into this project.
TO DO LIST
- Distillation on FCOS
- Distillation on CondInst
Contribute
To contribute, PR is appreciated and suggestions are welcome to discuss with.