• Stars
    star
    196
  • Rank 198,553 (Top 4 %)
  • Language
    Python
  • License
    BSD 3-Clause "New...
  • Created over 4 years ago
  • Updated about 4 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Streaming Anomaly Detection Framework in Python (Outlier Detection for Streaming Data)

docs/logo.png

Python Streaming Anomaly Detection (PySAD)

PyPI GitHub release (latest by date) Documentation status Gitter Azure Pipelines Build Status Travis CI Build Status Appveyor Build status Circle CI Coverage Status PyPI - Python Version Supported Platforms License

PySAD is an open-source python framework for anomaly detection on streaming multivariate data.

Documentation

Features

Online Anomaly Detection

PySAD provides methods for online/sequential anomaly detection, i.e. anomaly detection on streaming data, where model updates itself as a new instance arrives.

Resource-Efficient

Streaming methods efficiently handle the limitied memory and processing time requirements of the data streams so that they can be used in near real-time. The methods can only store an instance or a small window of recent instances.

Streaming Anomaly Detection Tools

PySAD contains stream simulators, evaluators, preprocessors, statistic trackers, postprocessors, probability calibrators and more. In addition to streaming models, PySAD also provides integrations for batch anomaly detectors of the PyOD so that they can be used in the streaming setting.

Comprehensiveness

PySAD serves models that are specifically designed for both univariate and multivariate data. Furthermore, one can experiment via PySAD in supervised, semi-supervised and unsupervised setting.

User Friendly

Users with any experience level can easily use PySAD. One can easily design experiments and combine the tools in the framework. Moreover, the existing methods in PySAD are easy to extend.

Free and Open Source Software (FOSS)

PySAD is distributed under BSD License 2.0 and favors FOSS principles.

Installation

The PySAD framework can be installed via:

pip install -U pysad

Alternatively, you can install the library directly using the source code in Github repository by:

git clone https://github.com/selimfirat/pysad.git
cd pysad
pip install .

Required Dependencies:

  • numpy>=1.18.5
  • scipy>=1.4.1
  • scikit-learn>=0.23.2
  • pyod>=0.7.7.1

Optional Dependencies:

  • rrcf==0.4.3 (Only required for pysad.models.robust_random_cut_forest.RobustRandomCutForest)
  • PyNomaly==0.3.3 (Only required for pysad.models.loop.StreamLocalOutlierProbability)
  • mmh3==2.5.1 (Only required for pysad.models.xstream.xStream)
  • pandas==1.1.0 (Only required for pysad.utils.pandas_streamer.PandasStreamer)

Quick Links

Versioning

Semantic versioning is used for this project.

License

This project is licensed under the BSD License 2.0.

Citing PySAD

If you use PySAD for a scientific publication, we would appreciate citations to the following paper:

@article{pysad,
  title={PySAD: A Streaming Anomaly Detection Framework in Python},
  author={Yilmaz, Selim F and Kozat, Suleyman S},
  journal={arXiv preprint arXiv:2009.02572},
  year={2020}
}

More Repositories

1

bilkent-turkish-writings-dataset

Turkish writings dataset that promotes creativity, content, composition, grammar, spelling and punctuation.
Jupyter Notebook
36
star
2

ai-n-queens

Solving and GUI demonstration of traditional N-Queens Problem using Hill Climbing, Simulated Annealing, Local Beam Search, and Genetic Algorithm.
Java
36
star
3

addml

Unsupervised Anomaly Detection via Deep Metric Learning with End-to-End Optimization
Python
13
star
4

bilstats

BilStats is a web based tool for analyzing past courses and instructors on Bilkent University.
JavaScript
8
star
5

bilkent-meals-api

An unofficial meals API for Bilkent University Bilintur Catering Centre
Java
6
star
6

bilkent-video-annotation-tool

Bilkent Video Annotation Tool helps to annotate frame positions in videos.
Python
5
star
7

man-of-war

CS 319 Project of Group 1D.
Java
5
star
8

koala

Real Estate Project
Java
3
star
9

turkish-news-analytics

Analytics of Turkish News with Named Entity Recognition and Sentiment Detection (Course Project)
Python
3
star
10

bilnet-auto-login

Auto sign in tool for Bilnet (the network of Bilkent University)
C#
3
star
11

greenedge-energy-aware-classification

GreenEdge Contest: Energy-Aware Image Classification
Jupyter Notebook
3
star
12

denoising-autoencoder

Tensorflow Implementation of Denoising Autoencoder Using Dense Layers
Jupyter Notebook
2
star
13

ciftkale

Database Systems Project
JavaScript
2
star
14

cpp-study

Homeworks & some of codes I wrote while studying CS 201
C++
2
star
15

prerequisites-visualization

Visualizes prerequisite of courses in Bilkent University.
JavaScript
2
star
16

nino

Nino - Nino is not OCR! The smartest note taking app.
C++
1
star
17

beestalk

BeeStalk Application
CSS
1
star
18

multilingual-sentiment-analysis

Source Code and the executable model of the Multi-Label Sentiment Analysis on 100 Languages with Dynamic Weighting for Label-Imbalance Paper
1
star
19

iliad-literary-analysis

Literary Analysis of Homer’s The Iliad using NLP Methods
Jupyter Notebook
1
star
20

ai-maze-sudoku-solver

Solving maze & sudoku through CSP techniques.
C++
1
star
21

ocfpad

ConvLSTM Autoencoder for Face Presentation Attack Detection
Python
1
star
22

fedipc-spatial-reuse

FedIPC Spatial Reuse Project for ITU AI/ML Challenge 2021.
Python
1
star
23

oac-based-private-ensembles

Python
1
star
24

selimfirat

1
star
25

stars-fetcher-mobile

An unofficial Android application of Stars Fetcher which makes it able to see ID card photos of students of Bilkent University by student ID number.
Java
1
star
26

ai-topological-sort

Finding class precedence lists using topological sort.
JavaScript
1
star