• Stars
    star
    110
  • Rank 315,756 (Top 7 %)
  • Language
    MATLAB
  • Created over 5 years ago
  • Updated over 2 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

This Toolbox contains E-measure, S-measure, weighted F & F-measure, MAE and PR curves or bar metrics for salient object detection.

Saliency-Evaluation-Toolbox

This Toolbox contains near all evaluation metrics for salient object detection including:

  • E-measure
  • S-measure
  • weighted F-measure
  • F-measure
  • MAE scores
  • PR curves or bar metrics
  • Boundary Displacement Error

You can easily use this Tool Box to evaluate SOD results.

Citation

@article{Saliency-Evaluation-Toolbox,   
    Author = {Wei Ji},
    Title = {Evaluation Toolbox for Salient Object Detection.},
    Journal = {https://github.com/jiwei0921/Saliency-Evaluation-Toolbox/},
    Year = {2019}
} 

Requirement

  • MATLAB

Test E/S/weighted F/F-measure and MAE scores

  1. Set the path of GT and sal_map in main.m
  2. run main.m

Test PR curves

1 create .m file

  1. put your test_images in ./0 PR/Dataset
  2. set your_path and run ./0 PR/PR_sal2mat.m

2 prduce PR curves or PR bar

  1. run ./0 PR/code_bar.m or code_or.m

Boundary Displacement Error Metric

  1. It contains BDE metric, which borrows from this paper.
  2. Set the path of GT and sal_map in main.m
  3. run main.m (Source Code and fetch code is k2v6).
  4. This code is provided by Dr. Tang Lv. Thanks very much!

Related Citations

@article{sal_eval_toolbox,
    Author = {Mengyang Feng},
    Title = {Evaluation Toolbox for Salient Object Detection.},
    Journal = {https://github.com/ArcherFMY/sal_eval_toolbox},
    Year = {2018}
}
@article{borji2015salient,
	title="Salient Object Detection: A Benchmark",
	author="Ali {Borji} and Ming-Ming {Cheng} and Huaizu {Jiang} and Jia {Li}",
	journal="IEEE Transactions on Image Processing",
	volume="24",
	number="12",
	pages="5706--5722",
	year="2015"
}
@inproceedings{fan2017structure,
	title="Structure-Measure: A New Way to Evaluate Foreground Maps",
	author="Deng-Ping {Fan} and Ming-Ming {Cheng} and Yun {Liu} and Tao {Li} and Ali {Borji}",
	booktitle="2017 IEEE International Conference on Computer Vision (ICCV)",
	pages="4558--4567",
	year="2017"
}
@inproceedings{fan2018enhanced,
	title="Enhanced-alignment Measure for Binary Foreground Map Evaluation",
	author="Deng-Ping {Fan} and Cheng {Gong} and Yang {Cao} and Bo {Ren} and Ming-Ming {Cheng} and Ali {Borji}",
	booktitle="IJCAI 2018: 27th International Joint Conference on Artificial Intelligence",
	pages="698--704",
	year="2018"
}
@inproceedings{zhang2020weakly,
  title={Weakly-supervised salient object detection via scribble annotations},
  author={Zhang, Jing and Yu, Xin and Li, Aixuan and Song, Peipei and Liu, Bowen and Dai, Yuchao},
  booktitle={Proceedings of the IEEE/CVF conference on computer vision and pattern recognition},
  pages={12546--12555},
  year={2020}
}

More Repositories

1

SOD-CNNs-based-code-summary-

The summary of code and paper for salient object detection with deep learning.
838
star
2

DMRA

Code for ICCV 2019 paper. "Depth-induced Multi-scale Recurrent Attention Network for Saliency Detection". [RGB-D Salient Object Detection]
Python
102
star
3

MRNet

Code for CVPR 2021 paper. "Learning Calibrated Medical Image Segmentation via Multi-rater Agreement Modeling".
Python
96
star
4

RGBD-SOD-datasets

All those partitioned RGB-D Saliency Datasets we collected are shared in ready-to-use manner.
62
star
5

DCF

Code for CVPR 2021 paper. "Calibrated RGB-D Salient Object detection".
Python
36
star
6

CoNet

Code for ECCV 2020 paper. "Accurate RGB-D Salient Object Detection via Collaborative Learning".
Python
23
star
7

DSU

Code for ICLR 2022 paper. "Promoting Saliency From Depth: Deep Unsupervised RGB-D Saliency Detection".
Python
15
star
8

Deep_Learning-Notebook

Paper list
13
star
9

MoLF

Code and Dataset for NeurIPS 2019 paper. "Memory-oriented Decoder for Light Field Salient Object Detection".
12
star
10

DenseCRF_refine_saliency-map

Dense CRF in Saliency Detection field. [Python Implementation]
Python
11
star
11

JSM

Code for NeurIPS 2021 paper. "Joint Semantic Mining for Weakly Supervised RGB-D Salient Object Detection".
Python
8
star
12

MVSS-Baseline

Baseline Code for CVPR 2023 paper. "Multispectral Video Semantic Segmentation: A Benchmark Dataset and Baseline".
Python
8
star
13

Saliency-dataset-evaluation

This repo can compute the ratio of obj.area and obj.contrast on binary saliency dataset.
MATLAB
8
star
14

SemanticRT

Dataset & Code for ACM Multimedia 2023 paper. "SemanticRT: A Large-Scale Dataset and Method for Robust Semantic Segmentation in Multispectral Images".
Python
7
star
15

HiBo-UA

Python
5
star
16

Multispectral-Video-Semantic-Segmentation

Project website for CVPR'23 - Multispectral Video Semantic Segmentation
JavaScript
4
star
17

LFNet

LFNet: Light-Field Fusion Network for Salient Object Detection
1
star