Implementing Searching for MobileNetV3 paper using Pytorch
- The current model is a very early model. I will modify it as a general model as soon as possible.
Paper
- Searching for MobileNetV3 paper
- Author: Andrew Howard(Google Research), Mark Sandler(Google Research, Grace Chu(Google Research), Liang-Chieh Chen(Google Research), Bo Chen(Google Research), Mingxing Tan(Google Brain), Weijun Wang(Google Research), Yukun Zhu(Google Research), Ruoming Pang(Google Brain), Vijay Vasudevan(Google Brain), Quoc V. Le(Google Brain), Hartwig Adam(Google Research)
Todo
- Experimental need for ImageNet dataset.
- Code refactoring
MobileNetV3 Block
Experiments
- For CIFAR-100 data, I experimented with resize (224, 224).
| Datasets | Model | acc1 | acc5 | Epoch | Parameters |
|---|---|---|---|---|---|
| CIFAR-100 | MobileNetV3(LARGE) | 70.44% | 91.34% | 80 | 3.99M |
| CIFAR-100 | MobileNetV3(SMALL) | 67.04% | 89.41% | 55 | 1.7M |
| IMAGENET | MobileNetV3(LARGE) WORK IN PROCESS | 5.15M | |||
| IMAGENET | MobileNetV3(SMALL) WORK IN PROCESS | 2.94M |
Usage
Train
python main.py
- If you want to change hyper-parameters, you can check "python main.py --help"
Options:
--dataset-mode(str) - which dataset you use, (example: CIFAR10, CIFAR100), (default: CIFAR100).--epochs(int) - number of epochs, (default: 100).--batch-size(int) - batch size, (default: 128).--learning-rate(float) - learning rate, (default: 1e-1).--dropout(float) - dropout rate, (default: 0.3).--model-mode(str) - which network you use, (example: LARGE, SMALL), (default: LARGE).--load-pretrained(bool) - (default: False).--evaluate(bool) - Used when testing. (default: False).--multiplier(float) - (default: 1.0).
Test
python main.py --evaluate True
- Put the saved model file in the checkpoint folder and saved graph file in the saved_graph folder and type "python main.py --evaluate True".
- If you want to change hyper-parameters, you can check "python test.py --help"
Options:
--dataset-mode(str) - which dataset you use, (example: CIFAR10, CIFAR100), (default: CIFAR100).--epochs(int) - number of epochs, (default: 100).--batch-size(int) - batch size, (default: 128).--learning-rate(float) - learning rate, (default: 1e-1).--dropout(float) - dropout rate, (default: 0.3).--model-mode(str) - which network you use, (example: LARGE, SMALL), (default: LARGE).--load-pretrained(bool) - (default: False).--evaluate(bool) - Used when testing. (default: False).--multiplier(float) - (default: 1.0).
Number of Parameters
import torch
from model import MobileNetV3
def get_model_parameters(model):
total_parameters = 0
for layer in list(model.parameters()):
layer_parameter = 1
for l in list(layer.size()):
layer_parameter *= l
total_parameters += layer_parameter
return total_parameters
tmp = torch.randn((128, 3, 224, 224))
model = MobileNetV3(model_mode="LARGE", multiplier=1.0)
print("Number of model parameters: ", get_model_parameters(model))Requirements
- torch==1.0.1