SiameseX.PyTorch
A simplified PyTorch implementation of Siamese networks for tracking: SiamFC, SiamVGG, SiamDW, SiamRPN, SiamRPN++.
Warning: It is still in development, some files are just for the integrity of the project.
Dependencies
- python2.7
- pytorch == 0.4.0
- opencv
- mmcv
Currently supported models
Backbones
- AlexNet
- VGG
- ResNet22
- Incep22
- ResNeXt22
- ResNet50
Demo
- Try SiamFC:
Clone this repo and run
python demo.py --model SiamFC
You can change --mdoel to other models like
python demo.py --model SiamFCNext22
- Try SiamRPN:
Download the pretrained model and put it in ./cp folder.
python demo_rpn.py --model SiamRPNResNeXt22
- Try SiamRPN++:
Download the pretrained model and put it in ./cp folder.
python demo_rpn.py --model SiamRPNPPRes50
- You'll see the following:
Training
- download VID dataset (I did not use Youtube-bb because of limited resources).
- download label files from here and run
label_preprocess.py --file --output_file --pathto replace my file path by yours, these three arguments should be treated carefully. - train SiamFCNext22 tracker
python train.py --gpu 0 --config configs/SiamFC.py
- just replace
--configargument and you can train other models
python train.py --gpu 0 --config configs/SiamRPN.py
TODO
We have accumulated the following to-do list, which we hope to complete in the near future
- Still to come:
- Add testing code on common datasets
- Add SiamRPN(AlexNet as backbone)
- Add SiamRPN(VGG as backbone)
- Add SiamRPN(ResNet, ResNext, Inception as backbone)
Citation
@inproceedings{bertinetto2016fully,
title={Fully-convolutional siamese networks for object tracking},
author={Bertinetto, Luca and Valmadre, Jack and Henriques, Joao F and Vedaldi, Andrea and Torr, Philip HS},
booktitle={European conference on computer vision},
pages={850--865},
year={2016},
organization={Springer}
}
@inproceedings{Li2019SiamVGGVT,
title={SiamVGG: Visual Tracking using Deeper Siamese Networks},
author={Yuhong Li and Xiaofan Zhang},
year={2019}
}
@inproceedings{SiamDW_2019_CVPR,
author={Zhang, Zhipeng and Peng, Houwen},
title={Deeper and Wider Siamese Networks for Real-Time Visual Tracking},
booktitle = {The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
year = {2019}
@article{li2018siamrpn++,
title={SiamRPN++: Evolution of Siamese Visual Tracking with Very Deep Networks},
author={Li, Bo and Wu, Wei and Wang, Qiang and Zhang, Fangyi and Xing, Junliang and Yan, Junjie},
journal={arXiv preprint arXiv:1812.11703},
year={2018}
}
}