Hierarchical Multi-scale Representations for medical image segmentation with state of the art results on synapse multi-organ segmentation, skin lesion segmentation, multiple myeloma cell segmentation. This method designs two multi-scale feature representations using the seminal Swin Transformer module and a CNN-based encoder, then using a Double-Level Fusion (DLF) module, it allows a fine fusion of global and local features. If this code helps with your research please consider citing the following paper:

Moein Heidari*, Amirhossein Kazerouni*, Milad Soltany*, R. Azad, Ehsan Khodapanah Aghdam, Julien Cohen-Adad and Dorit Merhof , "HiFormer: Hierarchical Multi-scale Representations Using Transformers for Medical Image Segmentation", download link.

• October 10, 2022: Accepted in WACV 2023!
• July 14, 2022: First release (Complete implemenation for Synapse Multi-Organ Segmentation dataset.)

This code has been implemented in python language using Pytorch library and tested in ubuntu OS, though should be compatible with related environment. following Environement and Library needed to run the code:

• Python 3
• Pytorch

Please go to "Instructions.ipynb" for complete detail on dataset preparation and Train/Test procedure or follow the instructions below.

1. Download the Synapse Dataset from here.

2. Run the following code to install the Requirements.

   pip install -r requirements.txt

3. Run the below code to train HiFormer on the synapse dataset.

   python train.py --root_path ./data/Synapse/train_npz --test_path ./data/Synapse/test_vol_h5  --model_name hiformer-b --batch_size 10 --eval_interval 20 --max_epochs 400 

   --root_path [Train data path]

   --test_path [Test data path]

   --eval_interval [Evaluation epoch]

   --model_name [Choose from [hiformer-s, hiformer-b, hiformer-l]]

4. Run the below code to test HiFormer on the synapse dataset.

   python test.py --test_path ./data/Synapse/test_vol_h5 --model_name hiformer-b --is_savenii --model_weight './hiformer-b_best.pth'

   --test_path [Test data path]

   --model_name [choose from [hiformer-s, hiformer-b, hiformer-l]]

   --is_savenii [Whether to save results during inference]

   --model_weight [HiFormer trained model path]

For evaluating the performance of the proposed method, three challenging tasks in medical image segmentaion has been considered. In bellow, results of the proposed approach for synapse multi-organ segmentation is illustrated.

• TransUnet
• Swin Transformer
• CrossViT

All implementations are done by Amirhossein Kazerouni, Milad Soltany and Moein Heidari. For any query please contact us for more information.

[email protected]

[email protected]

[email protected]

@inproceedings{heidari2023hiformer,
  title={Hiformer: Hierarchical multi-scale representations using transformers for medical image segmentation},
  author={Heidari, Moein and Kazerouni, Amirhossein and Soltany, Milad and Azad, Reza and Aghdam, Ehsan Khodapanah and Cohen-Adad, Julien and Merhof, Dorit},
  booktitle={Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision},
  pages={6202--6212},
  year={2023}
}