yzhao062/WSAD yzhao062/WSAD

  • Stars
    star
    134
  • Rank 270,967 (Top 6 %)
  • Language
    Python
  • License
    MIT License
  • Created almost 2 years ago
  • Updated almost 2 years ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
yzhao062/WSAD
github

yzhao062

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

A Collection of Resources for Weakly-supervised Anomaly Detection (WSAD)

Weakly-supervised Anomaly Detection: A Survey

This repo is constructed for collecting and categorizing papers about weakly supervised anomaly detection models according to our survey paperโ€”โ€”Weakly Supervised Anomaly Detection: A Survey

Summary and categorization of weakly supervised anomaly detection (WSAD) algorithms

We first summarize and further categorize existing WSAD algorithms into three categories, including: (i) incomplete supervision; (ii) inexact supervision; (iii) inaccurate supervision

1.Summary of WSAD Algorithms

Method Reference Venue Backbone Modalities Key Idea Official Code
Incomplete Supervision
OE ref KDD'14 - Tabular Anomaly feature representation learning ร—
XGBOD ref IJCNN'18 - Tabular Anomaly feature representation learning โˆš
DeepSAD ref ICLR'20 MLP Tabular Anomaly feature representation learning โˆš
ESAD ref Preprint MLP Tabular Anomaly feature representation learning ร—
DSSAD ref ICASSP'21 CNN Image/Video Anomaly feature representation learning ร—
REPEN ref KDD'18 MLP Tabular Anomaly feature representation learning ร—
AA-BiGAN ref IJCAI'22 GAN Tabular Anomaly feature representation learning โˆš
Dual-MGAN ref TKDD'22 GAN Tabular Anomaly feature representation learning โˆš
DevNet ref KDD'19 MLP Tabular Anomaly score learning โˆš
PReNet ref Preprint MLP Tabular Anomaly score learning ร—
FEAWAD ref TNNLS'21 AE Tabular Anomaly score learning โˆš
SNARE ref KDD'09 - Graph Graph learning and label propagation ร—
AESOP ref KDD'14 - Graph Graph learning and label propagation ร—
SemiGNN ref ICDM'19 MLP+Attention Graph Graph learning and label propagation ร—
SemiGAD ref IJCNN'21 GNN Graph Graph learning and label propagation ร—
Meta-GDN ref WWW'21 GNN Graph Graph learning and label propagation โˆš
SemiADC ref IS Journal'21 GAN Graph Graph learning and label propagation ร—
SSAD ref JAIR'13 - Tabular Active learning ร—
AAD ref ICDM'16 - Tabular Active learning โˆš
SLA-VAE ref WWW'22 VAE Time series Active learning ร—
Meta-AAD ref ICDM'20 MLP Tabular Reinforcement learning โˆš
DPLAN ref KDD'21 MLP Tabular Reinforcement learning ร—
GraphUCB ref WSDM'19 - Graph Reinforcement learning โˆš
Inexact Supervision
MIL ref CVPR'18 MLP Video Multiple Instance Learning โˆš
TCN-IBL ref ICIP'19 CNN Video Multiple Instance Learning ร—
AR-Net ref ICME'20 MLP Video Multiple Instance Learning โˆš
RTFM ref ICCV'21 CNN+Attention Video Multiple Instance Learning โˆš
Motion-Aware ref BMVC'19 AE+Attention Video Multiple Instance Learning ร—
CRF-Attention ref ICCV'21 TRN+Attention Video Multiple Instance Learning ร—
MPRF ref IJCAI'21 MLP+Attention Video Multiple Instance Learning ร—
MCR ref ICME'22 MLP+Attention Video Multiple Instance Learning ร—
XEL ref SPL'21 MLP Video Cross-epoch Learning โˆš
MIST ref CVPR'21 MLP+Attention Video Multiple Instance Learning โˆš
MSLNet ref AAAI'22 Transformer Video Multiple Instance Learning โˆš
SRF ref SPL'20 MLP Video Self Reasoning ร—
WETAS ref ICCV'21 MLP Time-series/Video Dynamic Time Warping ร—
Inexact AUC ref ML Journal'20 AE Tabular AUC maximization ร—
Isudra ref TIST'21 - Time-series Bayesian optimization โˆš
Inaccurate Supervision
LAC ref CIKM'21 MLP/GBDT Tabular Ensemble learning ร—
ADMoE ref AAAI'23 Agnostic Tabular Ensemble learning โˆš
BGPAD ref ICNP'21 LSTM+Attention Time series Denoising network โˆš
SemiADC ref IS Journal'21 GAN Graph Denoising network ร—
TSN ref CVPR'19 GCN Video GCN โˆš

2.Categorization of WSAD algorithms

2.1 AD with Incomplete Supervision

2.2 AD with Inexact Supervision

2.3 AD with Inaccurate Supervision

Experiment

One can easily reproduce the experimental results in our paper by running the run.py python file in the experiments folder.

Method $\gamma_{l}=1$% $\gamma_{l}=5$% $\gamma_{l}=25$% $\gamma_{l}=50$%
AUC-ROC
XGBOD 80.03 86.68 93.20 95.28
DeepSAD 75.25 81.74 89.64 92.72
REPEN 77.20 82.23 86.26 87.45
DevNet 79.05 85.94 89.76 90.97
PReNet 79.04 85.66 89.88 91.11
FEAWAD 73.93 82.44 89.20 91.55
AUC-PR
XGBOD 46.23 61.58 75.89 80.57
DeepSAD 38.06 49.65 67.04 74.47
REPEN 46.57 56.38 63.39 65.73
DevNet 53.61 64.01 69.52 71.13
PReNet 54.52 64.19 70.46 71.62
FEAWAD 51.19 62.30 69.65 72.34

More Repositories

1

pyod

A Comprehensive and Scalable Python Library for Outlier Detection (Anomaly Detection)
Python
7,613
star
2

anomaly-detection-resources

Anomaly detection related books, papers, videos, and toolboxes
Python
7,290
star
3

combo

(AAAI' 20) A Python Toolbox for Machine Learning Model Combination
Python
616
star
4

SUOD

(MLSys' 21) An Acceleration System for Large-scare Unsupervised Heterogeneous Outlier Detection (Anomaly Detection)
Python
363
star
5

data-mining-conferences

Ranking, acceptance rate, deadline, and publication tips
Python
305
star
6

awesome-ensemble-learning

Ensemble learning related books, papers, videos, and toolboxes
Python
256
star
7

pytod

TOD: GPU-accelerated Outlier Detection via Tensor Operations
Python
149
star
8

MetaOD

Automating Outlier Detection via Meta-Learning (Code, API, and Contribution Instructions)
Python
144
star
9

XGBOD

Supplementary material for IJCNN paper "XGBOD: Improving Supervised Outlier Detection with Unsupervised Representation Learning"
Python
69
star
10

LSCP

Supplementary material for SDM 19 paper "LSCP: Locally Selective Combination in Parallel Outlier Ensembles"
Python
29
star
11

DCSO

Supplementary material for KDD 2018 workshop "DCSO: Dynamic Combination of Detector Scores for Outlier Ensembles"
Python
19
star
12

UOMS

Resources and environment for unsupervised outlier model selection (UOMS)
Jupyter Notebook
17
star
13

mmad

multimodal anomaly detection
Python
13
star
14

yzhao062

11
star
15

OutlierDetection.jl

A Julia Library for Outlier Detection (Anomaly Detection)
Julia
9
star
16

fedod

Python
8
star
17

pyod-dask

An embarrassingly simple extension of PyOD for scalable outlier detection
8
star
18

ELECT

Toward Unsupervised Outlier Model Selection (ICDM 2022)
Python
6
star
19

algs

An AutoML system for algorithm selection (model selection)
3
star
20

DataStructure_CPP

It is a repository to store multiple implementation of data structures and algorithms in C++ written by me in the past several years.
C++
2
star
21

MLMM

A Monitoring framework to track Machine Learning Model training processes
2
star
22

SIML

SImilarity Measure Library: an extended python library for measuring similarities
2
star
23

Coding-questions

Elements in Interview C++ alternative solutions
C++
2
star
24

Simulation-Modeling-with-Machine-Learning

The project demonstrate how to incorporate simulation modeling with machine learning techniques
2
star
25

Financial-Models

2
star
26

OD-Econometrics

Outlier Detection and Removal for Econometrics Models
Python
1
star
27

starter-hugo-academic

1
star
28

yzhao062.github.io

HTML
1
star