• Stars
    star
    138
  • Rank 256,055 (Top 6 %)
  • Language
    Python
  • License
    MIT License
  • Created over 2 years ago
  • Updated 5 months ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

icip2022 paper: sahi benchmark on visdrone and xview datasets using fcos, vfnet and tood detectors

small-object-detection-benchmark

ci fcakyon twitter

🔥 our paper has been presented in ICIP 2022 Bordeaux, France (16-19 October 2022)

📜 List of publications that cite this work (currently 70+)

summary

small-object-detection benchmark on visdrone and xview datasets using fcos, vfnet and tood detectors

refer to Slicing Aided Hyper Inference and Fine-tuning for Small Object Detection for full technical analysis

citation

If you use any file/result from this repo in your work, please cite it as:

@article{akyon2022sahi,
  title={Slicing Aided Hyper Inference and Fine-tuning for Small Object Detection},
  author={Akyon, Fatih Cagatay and Altinuc, Sinan Onur and Temizel, Alptekin},
  journal={2022 IEEE International Conference on Image Processing (ICIP)},
  doi={10.1109/ICIP46576.2022.9897990},
  pages={966-970},
  year={2022}
}

visdrone results

refer to table 1 in Slicing Aided Hyper Inference and Fine-tuning for Small Object Detection for more detail on visdrone results

setup AP50 AP50s AP50m AP50l results checkpoints
FCOS+FI 25.8 14.2 39.6 45.1 download request
FCOS+SAHI+PO 29.0 18.9 41.5 46.4 download request
FCOS+SAHI+FI+PO 31.0 19.8 44.6 49.0 download request
FCOS+SF+SAHI+PO 38.1 25.7 54.8 56.9 download download
FCOS+SF+SAHI+FI+PO 38.5 25.9 55.4 59.8 download download
--- --- --- --- --- --- ---
VFNet+FI 28.8 16.8 44.0 47.5 download request
VFNet+SAHI+PO 32.0 21.4 45.8 45.5 download request
VFNet+SAHI+FI+PO 33.9 22.4 49.1 49.4 download request
VFNet+SF+SAHI+PO 41.9 29.7 58.8 60.6 download request
VFNet+SF+SAHI+FI+PO 42.2 29.6 59.2 63.3 download request
--- --- --- --- --- --- ---
TOOD+FI 29.4 18.1 44.1 50.0 download request
TOOD+SAHI 31.9 22.6 44.0 45.2 download request
TOOD+SAHI+PO 32.5 22.8 45.2 43.6 download request
TOOD+SAHI+FI 34.6 23.8 48.5 53.1 download request
TOOD+SAHI+FI+PO 34.7 23.8 48.9 50.3 download request
TOOD+SF+FI 36.8 24.4 53.8 66.4 download download
TOOD+SF+SAHI 42.5 31.6 58.0 61.1 download download
TOOD+SF+SAHI+PO 43.1 31.7 59.0 60.2 download download
TOOD+SF+SAHI+FI 43.4 31.7 59.6 65.6 download download
TOOD+SF+SAHI+FI+PO 43.5 31.7 59.8 65.4 download download

xview results

refer to table 2 in Slicing Aided Hyper Inference and Fine-tuning for Small Object Detection for more detail on xview results

setup AP50 AP50s AP50m AP50l results checkpoints
FCOS+FI 2.20 0.10 1.80 7.30 download request
FCOS+SF+SAHI 15.8 11.9 18.4 11.0 download download
FCOS+SF+SAHI+PO 17.1 12.2 20.2 12.8 download download
FCOS+SF+SAHI+FI 15.7 11.9 18.4 14.3 download download
FCOS+SF+SAHI+FI+PO 17.0 12.2 20.2 15.8 download download
--- --- --- --- --- --- ---
VFNet+FI 2.10 0.50 1.80 6.80 download request
VFNet+SF+SAHI 16.0 11.9 17.6 13.1 download download
VFNet+SF+SAHI+PO 17.7 13.7 19.7 15.4 download download
VFNet+SF+SAHI+FI 15.8 11.9 17.5 15.2 download download
VFNet+SF+SAHI+FI+PO 17.5 13.7 19.6 17.6 download download
--- --- --- --- --- --- ---
TOOD+FI 2.10 0.10 2.00 5.20 download request
TOOD+SF+SAHI 19.4 14.6 22.5 14.2 download download
TOOD+SF+SAHI+PO 20.6 14.9 23.6 17.0 download download
TOOD+SF+SAHI+FI 19.2 14.6 22.3 14.7 download download
TOOD+SF+SAHI+FI+PO 20.4 14.9 23.5 17.6 download download

env setup

install pytorch:

conda install pytorch=1.10.0 torchvision=0.11.1 cudatoolkit=11.3 -c pytorch

install other requirements:

pip install -r requirements.txt

evaluation

  • download desired checkpoint from the urls in readme.

  • download xivew or visdrone dataset and convert to COCO format.

  • set MODEL_PATH, MODEL_CONFIG_PATH, EVAL_IMAGES_FOLDER_DIR, EVAL_DATASET_JSON_PATH, INFERENCE_SETTING in predict_evaluate_analyse script then run the script.

roadmap

  • add train test split support for xview to coco converter
  • add mmdet config files (fcos, vfnet and tood) for xview training (9 train experiments)
  • add mmdet config files (fcos, vfnet and tood) for visdrone training (9 train experiments)
  • add coco result.json files, classwise coco eval results error analysis plots for all xview experiments
  • add coco result.json files, classwise coco eval results error analysis plots for all visdrone experiments
  • add .py scripts for inference + evaluation + error analysis using sahi

More Repositories

1

yolov5-pip

Packaged version of ultralytics/yolov5 + many extra features
Python
284
star
2

content-moderation-deep-learning

Deep learning based content moderation from text, audio, video & image input modalities.
268
star
3

craft-text-detector

Packaged, Pytorch-based, easy to use, cross-platform version of the CRAFT text detector
Python
240
star
4

streamlit-image-comparison

Image comparison slider component for Streamlit
Python
193
star
5

video-transformers

Easiest way of fine-tuning HuggingFace video classification models
Python
116
star
6

pywhisper

openai/whisper + extra features
Python
93
star
7

balanced-loss

Easy to use class balanced cross entropy and focal loss implementation for Pytorch
Python
74
star
8

midv500

Download and convert MIDV-500 annotations to COCO instance segmentation format
Python
73
star
9

ultralyticsplus

Huggingface utilities for Ultralytics/YOLOv8
Python
72
star
10

flask-redis-docker

A minimal template for dockerized flask app with redis task queue
Python
56
star
11

instafake-dataset

Dataset for Intagram Fake and Automated Account Detection
Python
45
star
12

face-recognition-app-tutorial

A face recognition web app powered by Facenet model using Flask, OpenCV, Heroku
HTML
35
star
13

mmdetection-object-tracker

A lightweight script for performing Kalman filter based object tracking using MMDetection models.
Python
22
star
14

augmented-maskrcnn

Object detection and instance segmentation on MaskRCNN with torchvision, albumentations, tensorboard and cocoapi. Supports custom coco datasets with positive/negative samples.
Python
19
star
15

confplot

Confusion Matrix in Python: Plot a pretty confusion matrix (like Matlab) in python using seaborn and matplotlib
Python
9
star
16

face-detection-app-tutorial

A face detection web app powered by SSD face detecctor using Flask, OpenCV, Heroku
Jupyter Notebook
7
star
17

yolov5-to-supervisely

Use your yolov5 predictions as supervisely annotations
Python
4
star
18

ieee-fraud-detection

IEEE Fraud Detection with XGBoost and CatBoost
Jupyter Notebook
4
star
19

turkish-qa-datasets

creating this repo to host some turkish nlp datasets
3
star
20

earth2-scraper

Up-to-date earth2.io data
Python
3
star
21

musicalpy

Easiest way of combining a music and a video
Python
2
star
22

insta-assist

Personal Instagram Tools
Python
2
star
23

cifar100-resnet

ResNet Implementation for CIFAR100 in Pytorch
Jupyter Notebook
2
star
24

fcakyon

2
star
25

deprem-uydu-bina-tespiti

Instance segmentation ve change detection ile uydu goruntusunden bina tespiti
Python
2
star
26

gpt2-shakespeare

A tutorial on GPT2 language model training with texts from Shakespeare
Jupyter Notebook
1
star
27

glassdoor-review-textgenrnn

Train char-rnn with Glassdoor reviews and generate sentences
Python
1
star
28

DiyarMobileFood

C#
1
star
29

public-files

personal repo for hosting large files
1
star