Slimmable Networks

An open source framework for slimmable training on tasks of ImageNet classification and COCO detection, which has enabled numerous projects. ^{1, 2, 3}

1. Slimmable Neural Networks _{ICLR 2019 Paper | OpenReview | Detection | Model Zoo}

Illustration of slimmable neural networks. The same model can run at different widths (number of active channels), permitting instant and adaptive accuracy-efficiency trade-offs.

2. Universally Slimmable Networks and Improved Training Techniques _{ICCV 2019 Paper | Model Zoo}

Illustration of universally slimmable networks. The same model can run at arbitrary widths.

3. AutoSlim: Towards One-Shot Architecture Search for Channel Numbers _{NeurIPS 2019 Workshop Paper | Model Zoo}

AutoSlimming MobileNet v1, MobileNet v2, MNasNet and ResNet-50: the optimized number of channels under each computational budget (FLOPs).

Run

0. Requirements:
   • python3, pytorch 1.0, torchvision 0.2.1, pyyaml 3.13.
   • Prepare ImageNet-1k data following pytorch example.
1. Training and Testing:
   • The codebase is a general ImageNet training framework using yaml config under apps dir, based on PyTorch.
   • To test, download pretrained models to logs dir and directly run command.
   • To train, comment test_only and pretrained in config file. You will need to manage visible gpus by yourself.
   • Command: python train.py app:{apps/***.yml}. {apps/***.yml} is config file. Do not miss app: prefix.
   • Training and testing of MSCOCO benchmarks are released under branch detection.
2. Still have questions?
   • If you still have questions, please search closed issues first. If the problem is not solved, please open a new.

Slimmable Model Zoo

Slimmable Neural Networks

Universally Slimmable Networks and Improved Training Techniques

AutoSlim: Towards One-Shot Architecture Search for Channel Numbers

Technical Details

Implementing slimmable networks and slimmable training is straightforward:

• Switchable batchnorm and slimmable layers are implemented in models/slimmable_ops.
• Slimmable training is implemented in these lines in train.py.

License

CC 4.0 Attribution-NonCommercial International

The software is for educaitonal and academic research purpose only.