Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/yzhao062/anomaly-detection-resources
Anomaly detection related books, papers, videos, and toolboxes
https://github.com/yzhao062/anomaly-detection-resources
List: anomaly-detection-resources
anomaly-detection awesome awesome-list data-mining fraud fraud-detection graph-neural-networks machine-learning outlier outlier-detection outlier-ensembles time-series-analysis unsupervised-learning
Last synced: 3 months ago
JSON representation
Anomaly detection related books, papers, videos, and toolboxes
- Host: GitHub
- URL: https://github.com/yzhao062/anomaly-detection-resources
- Owner: yzhao062
- License: agpl-3.0
- Created: 2018-05-16T20:02:54.000Z (over 6 years ago)
- Default Branch: master
- Last Pushed: 2024-04-23T06:13:15.000Z (8 months ago)
- Last Synced: 2024-05-23T04:12:58.121Z (7 months ago)
- Topics: anomaly-detection, awesome, awesome-list, data-mining, fraud, fraud-detection, graph-neural-networks, machine-learning, outlier, outlier-detection, outlier-ensembles, time-series-analysis, unsupervised-learning
- Language: Python
- Homepage:
- Size: 236 KB
- Stars: 7,934
- Watchers: 286
- Forks: 1,720
- Open Issues: 11
-
Metadata Files:
- Readme: README.rst
- License: LICENSE
Awesome Lists containing this project
- awesome-artificial-intelligence-research - Anomaly Detection
- awesomeai - Anomaly Detection
- awesome-ai-awesomeness - Anomaly Detection
- awesome-of-awesome-ml - anomaly-detection-resources (by yzhao062)
- awesome-ai-awesomeness - Anomaly Detection
- awesome-hrv - Anomaly Detection Learning Resources
- Awesome-Paper-List - Anomaly Detection
- awesome-cv - anomaly-detection-resources
- awesome-ai-list-guide - anomaly-detection-resources
- awesome-machine-learning-resources - **[List - detection-resources?style=social) (Table of Contents)
- awesome-imbalanced-learning - Anomaly Detection Learning Resources - Anomaly detection related books, papers, videos, and toolboxes. (3.2 Github Repositories / 3.2.2 *Paper list*)
- StarryDivineSky - yzhao062/anomaly-detection-resources
- Awesome-Computer-Vision - 17
README
Anomaly Detection Learning Resources
====================================
.. image:: https://img.shields.io/github/stars/yzhao062/anomaly-detection-resources.svg
:target: https://github.com/yzhao062/anomaly-detection-resources/stargazers
:alt: GitHub stars
.. image:: https://img.shields.io/github/forks/yzhao062/anomaly-detection-resources.svg?color=blue
:target: https://github.com/yzhao062/anomaly-detection-resources/network
:alt: GitHub forks
.. image:: https://img.shields.io/github/license/yzhao062/anomaly-detection-resources.svg?color=blue
:target: https://github.com/yzhao062/anomaly-detection-resources/blob/master/LICENSE
:alt: License
.. image:: https://awesome.re/badge-flat2.svg
:target: https://awesome.re/badge-flat2.svg
:alt: Awesome
.. image:: https://img.shields.io/badge/ADBench-benchmark_results-pink
:target: https://github.com/Minqi824/ADBench
:alt: Benchmark
----
`Outlier Detection `_
(also known as *Anomaly Detection*) is an exciting yet challenging field,
which aims to identify outlying objects that are deviant from the general data distribution.
Outlier detection has been proven critical in many fields, such as credit card
fraud analytics, network intrusion detection, and mechanical unit defect detection.
**This repository collects**:
#. Books & Academic Papers
#. Online Courses and Videos
#. Outlier Datasets
#. Open-source and Commercial Libraries/Toolkits
#. Key Conferences & Journals
**More items will be added to the repository**.
Please feel free to suggest other key resources by opening an issue report,
submitting a pull request, or dropping me an email @ ([email protected]).
Enjoy reading!
BTW, you may find my `[GitHub] `_ and
`[outlier detection papers] `_ useful,
especially `PyOD library `_ and `ADBench benchmark `_.
----
Table of Contents
-----------------
* `1. Books & Tutorials & Benchmarks <#1-books--tutorials--benchmarks>`_
* `1.1. Books <#11-books>`_
* `1.2. Tutorials <#12-tutorials>`_
* `1.3. Benchmarks <#13-benchmarks>`_
* `2. Courses/Seminars/Videos <#2-coursesseminarsvideos>`_
* `3. Toolbox & Datasets <#3-toolbox--datasets>`_
* `3.1. Multivariate data outlier detection <#31-multivariate-data>`_
* `3.2. Time series outlier detection <#32-time-series-outlier-detection>`_
* `3.3. Graph Outlier Detection <#33-graph-outlier-detection>`_
* `3.4. Real-time Elasticsearch <#34-real-time-elasticsearch>`_
* `3.5. Datasets <#35-datasets>`_
* `4. Papers <#4-papers>`_
* `4.1. Overview & Survey Papers <#41-overview--survey-papers>`_
* `4.2. Key Algorithms <#42-key-algorithms>`_
* `4.3. Graph & Network Outlier Detection <#43-graph--network-outlier-detection>`_
* `4.4. Time Series Outlier Detection <#44-time-series-outlier-detection>`_
* `4.5. Feature Selection in Outlier Detection <#45-feature-selection-in-outlier-detection>`_
* `4.6. High-dimensional & Subspace Outliers <#46-high-dimensional--subspace-outliers>`_
* `4.7. Outlier Ensembles <#47-outlier-ensembles>`_
* `4.8. Outlier Detection in Evolving Data <#48-outlier-detection-in-evolving-data>`_
* `4.9. Representation Learning in Outlier Detection <#49-representation-learning-in-outlier-detection>`_
* `4.10. Interpretability <#410-interpretability>`_
* `4.11. Outlier Detection with Neural Networks <#411-outlier-detection-with-neural-networks>`_
* `4.12. Active Anomaly Detection <#412-active-anomaly-detection>`_
* `4.13. Interactive Outlier Detection <#413-interactive-outlier-detection>`_
* `4.14. Outlier Detection in Other fields <#414-outlier-detection-in-other-fields>`_
* `4.15. Outlier Detection Applications <#415-outlier-detection-applications>`_
* `4.16. Automated Outlier Detection <#416-automated-outlier-detection>`_
* `4.17. Machine Learning Systems for Outlier Detection <#417-machine-learning-systems-for-outlier-detection>`_
* `4.18. Fairness and Bias in Outlier Detection <#418-fairness-and-bias-in-outlier-detection>`_
* `4.19. Isolation-based Methods <#419-isolation-based-methods>`_
* `4.20. Emerging and Interesting Topics <#420-emerging-and-interesting-topics>`_
* `5. Key Conferences/Workshops/Journals <#5-key-conferencesworkshopsjournals>`_
* `5.1. Conferences & Workshops <#51-conferences--workshops>`_
* `5.2. Journals <#52-journals>`_
----
1. Books & Tutorials & Benchmarks
---------------------------------
1.1. Books
^^^^^^^^^^
`Outlier Analysis `_
by Charu Aggarwal: Classical text book covering most of the outlier analysis techniques.
A **must-read** for people in the field of outlier detection. `[Preview.pdf] `_
`Outlier Ensembles: An Introduction `_
by Charu Aggarwal and Saket Sathe: Great intro book for ensemble learning in outlier analysis.
`Data Mining: Concepts and Techniques (3rd) `_
by Jiawei Han and Micheline Kamber and Jian Pei: Chapter 12 discusses outlier detection with many key points. `[Google Search] `_
1.2. Tutorials
^^^^^^^^^^^^^^
===================================================== ============================================ ===== ============================ ==========================================================================================================================================================================
Tutorial Title Venue Year Ref Materials
===================================================== ============================================ ===== ============================ ==========================================================================================================================================================================
Data mining for anomaly detection PKDD 2008 [#Lazarevic2008Data]_ `[Video] `_
Outlier detection techniques ACM SIGKDD 2010 [#Kriegel2010Outlier]_ `[PDF] `_
Anomaly Detection: A Tutorial ICDM 2011 [#Chawla2011Anomaly]_ `[PDF] `_
Anomaly Detection in Networks KDD 2017 [#Mendiratta2017Anomaly]_ `[Page] `_
Which Outlier Detector Should I use? ICDM 2018 [#Ting2018Which]_ `[PDF] `_
Deep Learning for Anomaly Detection KDD 2020 [#Wang2020Deep]_ `[HTML] `_, `[Video] `_
Deep Learning for Anomaly Detection WSDM 2021 [#Pang2021Deep]_ `[HTML] `_
Toward Explainable Deep Anomaly Detection KDD 2021 [#Pang2021Toward]_ `[HTML] `_
Recent Advances in Anomaly Detection CVPR 2023 [#Pang2023recent]_ `[HTML] `_, `[Video] `_
Trustworthy Anomaly Detection SDM 2024 [#Yuan2024Trustworthy]_ `[HTML] `_
===================================================== ============================================ ===== ============================ ==========================================================================================================================================================================
1.3. Benchmarks
^^^^^^^^^^^^^^^
**News**: We just released a 36-page, the most comprehensive `anomaly detection benchmark paper `_.
The fully `open-sourced ADBench `_ compares 30 anomaly detection algorithms on 55 benchmark datasets.
============= ================================================================================================= ============================ ===== ============================ ==========================================================================================================================================================================
Data Types Paper Title Venue Year Ref Materials
============= ================================================================================================= ============================ ===== ============================ ==========================================================================================================================================================================
Time-series Revisiting Time Series Outlier Detection: Definitions and Benchmarks NeurIPS 2021 [#Lai2021Revisiting]_ `[PDF] `_, `[Code] `_
Graph Benchmarking Node Outlier Detection on Graphs NeurIPS 2022 [#Liu2022Benchmarking]_ `[PDF] `_, `[Code] `_
Graph GADBench: Revisiting and Benchmarking Supervised Graph Anomaly Detection NeurIPS 2023 [#Tang2023GADBench]_ `[PDF] `_, `[Code] `_
Tabular ADBench: Anomaly Detection Benchmark NeurIPS 2022 [#Han2022Adbench]_ `[PDF] `_, `[Code] `_
Tabular ADGym: Design Choices for Deep Anomaly Detection NeurIPS 2023 [#Jiang2023adgym]_ `[PDF] `_, `[Code] `_
============= ================================================================================================= ============================ ===== ============================ ==========================================================================================================================================================================
----
2. Courses/Seminars/Videos
--------------------------
**Coursera Introduction to Anomaly Detection (by IBM)**\ :
`[See Video] `_
**Get started with the Anomaly Detection API (by IBM)**\ :
`[See Website] `_
**Practical Anomaly Detection by appliedAI Institute**\:
`[See Website] `_, `[See Video] `_, `[See GitHub] `_
**Coursera Real-Time Cyber Threat Detection and Mitigation partly covers the topic**\ :
`[See Video] `_
**Coursera Machine Learning by Andrew Ng also partly covers the topic**\ :
* `Anomaly Detection vs. Supervised Learning `_
* `Developing and Evaluating an Anomaly Detection System `_
**Udemy Outlier Detection Algorithms in Data Mining and Data Science**\ :
`[See Video] `_
**Stanford Data Mining for Cyber Security** also covers part of anomaly detection techniques\ :
`[See Video] `_
----
3. Toolbox & Datasets
---------------------
3.1. Multivariate Data
^^^^^^^^^^^^^^^^^^^^^^
[**Python**] `Python Outlier Detection (PyOD) `_\ : PyOD is a comprehensive and scalable Python toolkit for detecting outlying objects in multivariate data. It contains more than 20 detection algorithms, including emerging deep learning models and outlier ensembles.
[**Python**, **GPU**] `TOD: Tensor-based Outlier Detection (PyTOD) `_: A general GPU-accelerated framework for outlier detection.
[**Python**] `Python Streaming Anomaly Detection (PySAD) `_\ : PySAD is a streaming anomaly detection framework in Python, which provides a complete set of tools for anomaly detection experiments. It currently contains more than 15 online anomaly detection algorithms and 2 different methods to integrate PyOD detectors to the streaming setting.
[**Python**] `Scikit-learn Novelty and Outlier Detection `_. It supports some popular algorithms like LOF, Isolation Forest, and One-class SVM.
[**Python**] `Scalable Unsupervised Outlier Detection (SUOD) `_\ : SUOD (Scalable Unsupervised Outlier Detection) is an acceleration framework for large-scale unsupervised outlier detector training and prediction, on top of PyOD.
[**Julia**] `OutlierDetection.jl `_\ : OutlierDetection.jl is a Julia toolkit for detecting outlying objects, also known as anomalies.
[**Java**] `ELKI: Environment for Developing KDD-Applications Supported by Index-Structures `_\ :
ELKI is an open source (AGPLv3) data mining software written in Java. The focus of ELKI is research in algorithms, with an emphasis on unsupervised methods in cluster analysis and outlier detection.
[**Java**] `RapidMiner Anomaly Detection Extension `_\ : The Anomaly Detection Extension for RapidMiner comprises the most well know unsupervised anomaly detection algorithms, assigning individual anomaly scores to data rows of example sets. It allows you to find data, which is significantly different from the normal, without the need for the data being labeled.
[**R**] `CRAN Task View: Anomaly Detection with R `_\ : This CRAN task view contains a list of packages that can be used for anomaly detection with R.
[**R**] `outliers package `_\ : A collection of some tests commonly used for identifying outliers in R.
[**Matlab**] `Anomaly Detection Toolbox - Beta `_\ : A collection of popular outlier detection algorithms in Matlab.
3.2. Time Series Outlier Detection
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[**Python**] `TODS `_\ : TODS is a full-stack automated machine learning system for outlier detection on multivariate time-series data.
[**Python**] `skyline `_\ : Skyline is a near real time anomaly detection system.
[**Python**] `banpei `_\ : Banpei is a Python package of the anomaly detection.
[**Python**] `telemanom `_\ : A framework for using LSTMs to detect anomalies in multivariate time series data.
[**Python**] `DeepADoTS `_\ : A benchmarking pipeline for anomaly detection on time series data for multiple state-of-the-art deep learning methods.
[**Python**] `NAB: The Numenta Anomaly Benchmark `_\ : NAB is a novel benchmark for evaluating algorithms for anomaly detection in streaming, real-time applications.
[**Python**] `CueObserve `_\ : Anomaly detection on SQL data warehouses and databases.
[**Python**] `Chaos Genius `_\ : ML powered analytics engine for outlier/anomaly detection and root cause analysis.
[**R**] `CRAN Task View: Anomaly Detection with R `_\ : This CRAN task view contains a list of packages that can be used for anomaly detection with R.
[**R**] `AnomalyDetection `_\ : AnomalyDetection is an open-source R package to detect anomalies which is robust, from a statistical standpoint, in the presence of seasonality and an underlying trend.
[**R**] `anomalize `_\ : The 'anomalize' package enables a "tidy" workflow for detecting anomalies in data.
3.3. Graph Outlier Detection
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[**Python**] `Python Graph Outlier Detection (PyGOD) `_\ : PyGOD is a Python library for graph outlier detection (anomaly detection). It includes more than 10 latest graph-based detection algorithms
3.4. Real-time Elasticsearch
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[**Open Distro**] `Real Time Anomaly Detection in Open Distro for Elasticsearch by Amazon `_\ : A machine learning-based anomaly detection plugins for Open Distro for Elasticsearch. See `Real Time Anomaly Detection in Open Distro for Elasticsearch `_.
[**Python**] `datastream.io `_\ : An open-source framework for real-time anomaly detection using Python, Elasticsearch and Kibana.
3.5. Datasets
^^^^^^^^^^^^^
**ELKI Outlier Datasets**\ : https://elki-project.github.io/datasets/outlier
**Outlier Detection DataSets (ODDS)**\ : http://odds.cs.stonybrook.edu/#table1
**Unsupervised Anomaly Detection Dataverse**\ : https://dataverse.harvard.edu/dataset.xhtml?persistentId=doi:10.7910/DVN/OPQMVF
**Anomaly Detection Meta-Analysis Benchmarks**\ : https://ir.library.oregonstate.edu/concern/datasets/47429f155
**Skoltech Anomaly Benchmark (SKAB)**\ : https://github.com/waico/skab
----
4. Papers
---------
4.1. Overview & Survey Papers
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Papers are sorted by the publication year.
====================================================================================================================== ============================ ===== ============================ ==========================================================================================================================================================================
Paper Title Venue Year Ref Materials
====================================================================================================================== ============================ ===== ============================ ==========================================================================================================================================================================
A survey of outlier detection methodologies ARTIF INTELL REV 2004 [#Hodge2004A]_ `[PDF] `_
Anomaly detection: A survey CSUR 2009 [#Chandola2009Anomaly]_ `[PDF] `_
A meta-analysis of the anomaly detection problem Preprint 2015 [#Emmott2015A]_ `[PDF] `_
On the evaluation of unsupervised outlier detection: measures, datasets, and an empirical study DMKD 2016 [#Campos2016On]_ `[HTML] `_, `[SLIDES] `_
A comparative evaluation of unsupervised anomaly detection algorithms for multivariate data PLOS ONE 2016 [#Goldstein2016A]_ `[PDF] `_
A comparative evaluation of outlier detection algorithms: Experiments and analyses Pattern Recognition 2018 [#Domingues2018A]_ `[PDF] `_
Research Issues in Outlier Detection Book Chapter 2019 [#Suri2019Research]_ `[HTML] `_
Quantitative comparison of unsupervised anomaly detection algorithms for intrusion detection SAC 2019 [#Falcao2019Quantitative]_ `[HTML] `_
Progress in Outlier Detection Techniques: A Survey IEEE Access 2019 [#Wang2019Progress]_ `[PDF] `_
Deep learning for anomaly detection: A survey Preprint 2019 [#Chalapathy2019Deep]_ `[PDF] `_
Anomalous Instance Detection in Deep Learning: A Survey Tech Report 2020 [#Bulusu2020Deep]_ `[PDF] `_
Anomaly detection in univariate time-series: A survey on the state-of-the-art Preprint 2020 [#Braei2020Anomaly]_ `[PDF] `_
Deep Learning for Anomaly Detection: A Review CSUR 2021 [#Pang2020Deep]_ `[PDF] `_
A Comprehensive Survey on Graph Anomaly Detection with Deep Learning TKDE 2021 [#Ma2021A]_ `[PDF] `_
Revisiting Time Series Outlier Detection: Definitions and Benchmarks NeurIPS 2021 [#Lai2021Revisiting]_ `[PDF] `_, `[Code] `_
A Unified Survey on Anomaly, Novelty, Open-Set, and Out-of-Distribution Detection: Solutions and Future Challenges Preprint 2021 [#Salehi2021A]_ `[PDF] `_
Self-Supervised Anomaly Detection: A Survey and Outlook Preprint 2022 [#Hojjati2022Self]_ `[PDF] `_
Weakly supervised anomaly detection: A survey Preprint 2023 [#Jiang2023weakly]_ `[PDF] `_, `[PDF] `_
====================================================================================================================== ============================ ===== ============================ ==========================================================================================================================================================================
4.2. Key Algorithms
^^^^^^^^^^^^^^^^^^^
All these algorithms are available in `Python Outlier Detection (PyOD) `_.
==================== ================================================================================================= ================================= ===== =========================== ==============================================================================================================================================================================================
Abbreviation Paper Title Venue Year Ref Materials
==================== ================================================================================================= ================================= ===== =========================== ==============================================================================================================================================================================================
kNN Efficient algorithms for mining outliers from large data sets ACM SIGMOD Record 2000 [#Ramaswamy2000Efficient]_ `[PDF] `_
KNN Fast outlier detection in high dimensional spaces PKDD 2002 [#Angiulli2002Fast]_ `[PDF] `_
LOF LOF: identifying density-based local outliers ACM SIGMOD Record 2000 [#Breunig2000LOF]_ `[PDF] `_
IForest Isolation forest ICDM 2008 [#Liu2008Isolation]_ `[PDF] `_
OCSVM Estimating the support of a high-dimensional distribution Neural Computation 2001 [#Scholkopf2001Estimating]_ `[PDF] `_
AutoEncoder Ensemble Outlier detection with autoencoder ensembles SDM 2017 [#Chen2017Outlier]_ `[PDF] `_
COPOD COPOD: Copula-Based Outlier Detection ICDM 2020 [#Li2020COPOD]_ `[PDF] `_
ECOD Unsupervised Outlier Detection Using Empirical Cumulative Distribution Functions TKDE 2022 [#Li2021ECOD]_ `[PDF] `_
==================== ================================================================================================= ================================= ===== =========================== ==============================================================================================================================================================================================
4.3. Graph & Network Outlier Detection
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
================================================================================================= ============================= ===== ============================ ==========================================================================================================================================================================
Paper Title Venue Year Ref Materials
================================================================================================= ============================= ===== ============================ ==========================================================================================================================================================================
Graph based anomaly detection and description: a survey DMKD 2015 [#Akoglu2015Graph]_ `[PDF] `_
Anomaly detection in dynamic networks: a survey WIREs Computational Statistic 2015 [#Ranshous2015Anomaly]_ `[PDF] `_
Outlier detection in graphs: On the impact of multiple graph models ComSIS 2019 [#Campos2019Outlier]_ `[PDF] `_
A Comprehensive Survey on Graph Anomaly Detection with Deep Learning TKDE 2021 [#Ma2021A]_ `[PDF] `_
================================================================================================= ============================= ===== ============================ ==========================================================================================================================================================================
4.4. Time Series Outlier Detection
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
===================================================================================================================================== ============================ ===== ============================ ==========================================================================================================================================================================
Paper Title Venue Year Ref Materials
===================================================================================================================================== ============================ ===== ============================ ==========================================================================================================================================================================
Outlier detection for temporal data: A survey TKDE 2014 [#Gupta2014Outlier]_ `[PDF] `_
Detecting spacecraft anomalies using lstms and nonparametric dynamic thresholding KDD 2018 [#Hundman2018Detecting]_ `[PDF] `_, `[Code] `_
Time-Series Anomaly Detection Service at Microsoft KDD 2019 [#Ren2019Time]_ `[PDF] `_
Revisiting Time Series Outlier Detection: Definitions and Benchmarks NeurIPS 2021 [#Lai2021Revisiting]_ `[PDF] `_, `[Code] `_
Graph-Augmented Normalizing Flows for Anomaly Detection of Multiple Time Series ICLR 2022 [#Dai2022Graph]_ `[PDF] `_, `[Code] `_
Drift doesn't matter: dynamic decomposition with diffusion reconstruction for unstable multivariate time series anomaly detection NeurIPS 2023 [#Wang2023Drift]_ `[PDF] `_, `[Code] `_
===================================================================================================================================== ============================ ===== ============================ ==========================================================================================================================================================================
4.5. Feature Selection in Outlier Detection
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
================================================================================================================ ============================ ===== ============================ ==========================================================================================================================================================================
Paper Title Venue Year Ref Materials
================================================================================================================ ============================ ===== ============================ ==========================================================================================================================================================================
Unsupervised feature selection for outlier detection by modelling hierarchical value-feature couplings ICDM 2016 [#Pang2016Unsupervised]_ `[PDF] `_
Learning homophily couplings from non-iid data for joint feature selection and noise-resilient outlier detection IJCAI 2017 [#Pang2017Learning]_ `[PDF] `_
================================================================================================================ ============================ ===== ============================ ==========================================================================================================================================================================
4.6. High-dimensional & Subspace Outliers
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
================================================================================================== ============================ ===== ============================ =======================================================================================================================================================================================================
Paper Title Venue Year Ref Materials
================================================================================================== ============================ ===== ============================ =======================================================================================================================================================================================================
A survey on unsupervised outlier detection in high-dimensional numerical data Stat Anal Data Min 2012 [#Zimek2012A]_ `[HTML] `_
Learning Representations of Ultrahigh-dimensional Data for Random Distance-based Outlier Detection SIGKDD 2018 [#Pang2018Learning]_ `[PDF] `_
Reverse Nearest Neighbors in Unsupervised Distance-Based Outlier Detection TKDE 2015 [#Radovanovic2015Reverse]_ `[PDF] `_, `[SLIDES] `_
Outlier detection for high-dimensional data Biometrika 2015 [#Ro2015Outlier]_ `[PDF] `_
================================================================================================== ============================ ===== ============================ =======================================================================================================================================================================================================
4.7. Outlier Ensembles
^^^^^^^^^^^^^^^^^^^^^^
================================================================================================= ============================ ===== ============================ ==========================================================================================================================================================================
Paper Title Venue Year Ref Materials
================================================================================================= ============================ ===== ============================ ==========================================================================================================================================================================
Outlier ensembles: position paper SIGKDD Explorations 2013 [#Aggarwal2013Outlier]_ `[PDF] `_
Ensembles for unsupervised outlier detection: challenges and research questions a position paper SIGKDD Explorations 2014 [#Zimek2014Ensembles]_ `[PDF] `_
An Unsupervised Boosting Strategy for Outlier Detection Ensembles PAKDD 2018 [#Campos2018An]_ `[HTML] `_
LSCP: Locally selective combination in parallel outlier ensembles SDM 2019 [#Zhao2019LSCP]_ `[PDF] `_
Adaptive Model Pooling for Online Deep Anomaly Detection from a Complex Evolving Data Stream KDD 2022 [#Yoon2022ARCUS]_ `[PDF] `_, `[Github] `_, `[Slide] `_
================================================================================================= ============================ ===== ============================ ==========================================================================================================================================================================
4.8. Outlier Detection in Evolving Data
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
================================================================================================== ============================ ===== ============================ ==========================================================================================================================================================================
Paper Title Venue Year Ref Materials
================================================================================================== ============================ ===== ============================ ==========================================================================================================================================================================
A Survey on Anomaly detection in Evolving Data: [with Application to Forest Fire Risk Prediction] SIGKDD Explorations 2018 [#Salehi2018A]_ `[PDF] `_
Unsupervised real-time anomaly detection for streaming data Neurocomputing 2017 [#Ahmad2017Unsupervised]_ `[PDF] `_
Outlier Detection in Feature-Evolving Data Streams SIGKDD 2018 [#Manzoor2018Outlier]_ `[PDF] `_, `[Github] `_
Evaluating Real-Time Anomaly Detection Algorithms--The Numenta Anomaly Benchmark ICMLA 2015 [#Lavin2015Evaluating]_ `[PDF] `_, `[Github] `_
MIDAS: Microcluster-Based Detector of Anomalies in Edge Streams AAAI 2020 [#Bhatia2020MIDAS]_ `[PDF] `_, `[Github] `_
NETS: Extremely Fast Outlier Detection from a Data Stream via Set-Based Processing VLDB 2019 [#Yoon2019NETS]_ `[PDF] `_, `[Github] `_, `[Slide] `_
Ultrafast Local Outlier Detection from a Data Stream with Stationary Region Skipping KDD 2020 [#Yoon2020STARE]_ `[PDF] `_, `[Github] `_, `[Slide] `_
Multiple Dynamic Outlier-Detection from a Data Stream by Exploiting Duality of Data and Queries SIGMOD 2021 [#Yoon2021MDUAL]_ `[PDF] `_, `[Github] `_, `[Slide] `_
Adaptive Model Pooling for Online Deep Anomaly Detection from a Complex Evolving Data Stream KDD 2022 [#Yoon2022ARCUS]_ `[PDF] `_, `[Github] `_, `[Slide] `_
================================================================================================== ============================ ===== ============================ ==========================================================================================================================================================================
4.9. Representation Learning in Outlier Detection
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
================================================================================================== ============================ ===== ============================ ==========================================================================================================================================================================
Paper Title Venue Year Ref Materials
================================================================================================== ============================ ===== ============================ ==========================================================================================================================================================================
Learning Representations of Ultrahigh-dimensional Data for Random Distance-based Outlier Detection SIGKDD 2018 [#Pang2018Learning]_ `[PDF] `_
Learning representations for outlier detection on a budget Preprint 2015 [#Micenkova2015Learning]_ `[PDF] `_
XGBOD: improving supervised outlier detection with unsupervised representation learning IJCNN 2018 [#Zhao2018Xgbod]_ `[PDF] `_
================================================================================================== ============================ ===== ============================ ==========================================================================================================================================================================
4.10. Interpretability
^^^^^^^^^^^^^^^^^^^^^^
================================================================================================= ============================ ===== ============================ ==========================================================================================================================================================================
Paper Title Venue Year Ref Materials
================================================================================================= ============================ ===== ============================ ==========================================================================================================================================================================
Explaining Anomalies in Groups with Characterizing Subspace Rules DMKD 2018 [#Macha2018Explaining]_ `[PDF] `_
Beyond Outlier Detection: LookOut for Pictorial Explanation ECML-PKDD 2018 [#Gupta2018Beyond]_ `[PDF] `_
Contextual outlier interpretation IJCAI 2018 [#Liu2018Contextual]_ `[PDF] `_
Mining multidimensional contextual outliers from categorical relational data IDA 2015 [#Tang2015Mining]_ `[PDF] `_
Discriminative features for identifying and interpreting outliers ICDE 2014 [#Dang2014Discriminative]_ `[PDF] `_
Sequential Feature Explanations for Anomaly Detection TKDD 2019 [#Siddiqui2019Sequential]_ `[HTML] `_
A Survey on Explainable Anomaly Detection TKDD 2023 [#Li2023XAD]_ `[HTML] `_
Explainable Contextual Anomaly Detection Using Quantile Regression Forests DMKD 2023 [#Li2023QCAD]_ `[HTML] `_
Beyond Outlier Detection: Outlier Interpretation by Attention-Guided Triplet Deviation Network WWW 2021 [#Xu2021Beyond]_ `[PDF] `_
================================================================================================= ============================ ===== ============================ ==========================================================================================================================================================================
4.11. Outlier Detection with Neural Networks
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
================================================================================================== ============================ ===== ============================ ==========================================================================================================================================================================
Paper Title Venue Year Ref Materials
================================================================================================== ============================ ===== ============================ ==========================================================================================================================================================================
Detecting spacecraft anomalies using lstms and nonparametric dynamic thresholding KDD 2018 [#Hundman2018Detecting]_ `[PDF] `_, `[Code] `_
MAD-GAN: Multivariate Anomaly Detection for Time Series Data with Generative Adversarial Networks ICANN 2019 [#Li2019MAD]_ `[PDF] `_, `[Code] `_
Generative Adversarial Active Learning for Unsupervised Outlier Detection TKDE 2019 [#Liu2019Generative]_ `[PDF] `_, `[Code] `_
Deep Autoencoding Gaussian Mixture Model for Unsupervised Anomaly Detection ICLR 2018 [#Zong2018Deep]_ `[PDF] `_, `[Code] `_
Deep Anomaly Detection with Outlier Exposure ICLR 2019 [#Hendrycks2019Deep]_ `[PDF] `_, `[Code] `_
Unsupervised Anomaly Detection With LSTM Neural Networks TNNLS 2019 [#Ergen2019Unsupervised]_ `[PDF] `_, `[IEEE] `_,
Effective End-to-end Unsupervised Outlier Detection via Inlier Priority of Discriminative Network NeurIPS 2019 [#Wang2019Effective]_ `[PDF] `_ `[Code] `_
Fascinating Supervisory Signals and Where to Find Them: Deep Anomaly Detection with Scale Learning ICML 2023 [#Xu2023Fascinating]_ `[PDF] `_, `[Code] `_
================================================================================================== ============================ ===== ============================ ==========================================================================================================================================================================
4.12. Active Anomaly Detection
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
================================================================================================== ============================ ===== ============================ ==========================================================================================================================================================================
Paper Title Venue Year Ref Materials
================================================================================================== ============================ ===== ============================ ==========================================================================================================================================================================
Active learning for anomaly and rare-category detection NeurIPS 2005 [#Pelleg2005Active]_ `[PDF] `_
Outlier detection by active learning SIGKDD 2006 [#Abe2006Outlier]_ `[PDF] `_
Active Anomaly Detection via Ensembles: Insights, Algorithms, and Interpretability Preprint 2019 [#Das2019Active]_ `[PDF] `_
Meta-AAD: Active Anomaly Detection with Deep Reinforcement Learning ICDM 2020 [#Zha2020Meta]_ `[PDF] `_
A3: Activation Anomaly Analysis ECML-PKDD 2020 [#Sperl2021A3]_ `[PDF] `_, `[Code] `_
================================================================================================== ============================ ===== ============================ ==========================================================================================================================================================================
4.13. Interactive Outlier Detection
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
================================================================================================= ============================ ===== ============================ ==========================================================================================================================================================================
Paper Title Venue Year Ref Materials
================================================================================================= ============================ ===== ============================ ==========================================================================================================================================================================
Learning On-the-Job to Re-rank Anomalies from Top-1 Feedback SDM 2019 [#Lamba2019Learning]_ `[PDF] `_
Interactive anomaly detection on attributed networks WSDM 2019 [#Ding2019Interactive]_ `[PDF] `_
eX2: a framework for interactive anomaly detection IUI Workshop 2019 [#Arnaldo2019ex2]_ `[PDF] `_
Tripartite Active Learning for Interactive Anomaly Discovery IEEE Access 2019 [#Zhu2019Tripartite]_ `[PDF] `_
================================================================================================= ============================ ===== ============================ ==========================================================================================================================================================================
4.14. Outlier Detection in Other fields
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
============== ================================================================================================= ============================ ===== ============================ ==========================================================================================================================================================================
Field Paper Title Venue Year Ref Materials
============== ================================================================================================= ============================ ===== ============================ ==========================================================================================================================================================================
**Text** Outlier detection for text data SDM 2017 [#Kannan2017Outlier]_ `[PDF] `_
============== ================================================================================================= ============================ ===== ============================ ==========================================================================================================================================================================
4.15. Outlier Detection Applications
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
======================== ================================================================================================= ============================ ===== ============================ ==========================================================================================================================================================================
Field Paper Title Venue Year Ref Materials
======================== ================================================================================================= ============================ ===== ============================ ==========================================================================================================================================================================
**Security** A survey of distance and similarity measures used within network intrusion anomaly detection IEEE Commun. Surv. Tutor. 2015 [#WellerFahy2015A]_ `[PDF] `_
**Security** Anomaly-based network intrusion detection: Techniques, systems and challenges Computers & Security 2009 [#GarciaTeodoro2009Anomaly]_ `[PDF] `_
**Finance** A survey of anomaly detection techniques in financial domain Future Gener Comput Syst 2016 [#Ahmed2016A]_ `[PDF] `_
**Traffic** Outlier Detection in Urban Traffic Data WIMS 2018 [#Djenouri2018Outlier]_ `[PDF] `_
**Social Media** A survey on social media anomaly detection SIGKDD Explorations 2016 [#Yu2016A]_ `[PDF] `_
**Social Media** GLAD: group anomaly detection in social media analysis TKDD 2015 [#Yu2015Glad]_ `[PDF] `_
**Machine Failure** Detecting the Onset of Machine Failure Using Anomaly Detection Methods DAWAK 2019 [#Riazi2019Detecting]_ `[PDF] `_
**Video Surveillance** AnomalyNet: An anomaly detection network for video surveillance TIFS 2019 [#Zhou2019AnomalyNet]_ `[IEEE] `_, `Code `_
======================== ================================================================================================= ============================ ===== ============================ ==========================================================================================================================================================================
4.16. Automated Outlier Detection
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
================================================================================================= ============================ ===== ============================ ==========================================================================================================================================================================
Paper Title Venue Year Ref Materials
================================================================================================= ============================ ===== ============================ ==========================================================================================================================================================================
AutoML: state of the art with a focus on anomaly detection, challenges, and research directions Int J Data Sci Anal 2022 [#Bahri2022automl]_ `[PDF] `_
AutoOD: Automated Outlier Detection via Curiosity-guided Search and Self-imitation Learning ICDE 2020 [#Li2020AutoOD]_ `[PDF] `_
Automatic Unsupervised Outlier Model Selection NeurIPS 2021 [#Zhao2020Automating]_ `[PDF] `_, `[Code] `_
================================================================================================= ============================ ===== ============================ ==========================================================================================================================================================================
4.17. Machine Learning Systems for Outlier Detection
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
This section summarizes a list of systems for outlier detection, which may
overlap with the section of tools and libraries.
================================================================================================= ============================ ===== ============================ ==========================================================================================================================================================================
Paper Title Venue Year Ref Materials
================================================================================================= ============================ ===== ============================ ==========================================================================================================================================================================
PyOD: A Python Toolbox for Scalable Outlier Detection JMLR 2019 [#Zhao2019PYOD]_ `[PDF] `_, `[Code] `_
SUOD: Accelerating Large-Scale Unsupervised Heterogeneous Outlier Detection MLSys 2021 [#Zhao2021SUOD]_ `[PDF] `_, `[Code] `_
TOD: Tensor-based Outlier Detection Preprint 2021 [#Zhao2021TOD]_ `[PDF] `_, `[Code] `_
================================================================================================= ============================ ===== ============================ ==========================================================================================================================================================================
4.18. Fairness and Bias in Outlier Detection
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
================================================================================================= ============================ ===== ============================ ==========================================================================================================================================================================
Paper Title Venue Year Ref Materials
================================================================================================= ============================ ===== ============================ ==========================================================================================================================================================================
A Framework for Determining the Fairness of Outlier Detection ECAI 2020 [#Davidson2020A]_ `[PDF] `_
FAIROD: Fairness-aware Outlier Detection AIES 2021 [#Shekhar2021FAIROD]_ `[PDF] `_
================================================================================================= ============================ ===== ============================ ==========================================================================================================================================================================
4.19. Isolation-Based Methods
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
================================================================================================= ============================ ===== ============================= ==============================================================================================================================================================================================
Paper Title Venue Year Ref Materials
================================================================================================= ============================ ===== ============================= ==============================================================================================================================================================================================
Isolation forest ICDM 2008 [#Liu2008Isolation]_ `[PDF] `_
Isolation‐based anomaly detection using nearest‐neighbor ensembles Computational Intelligence 2018 [#Bandaragoda2018Isolation]_ `[PDF] `_, `[Code] `_
Extended Isolation Forest TKDE 2019 [#Hariri2019Extended]_ `[PDF] `_, `[Code] `_
Isolation Distributional Kernel: A New Tool for Kernel based Anomaly Detection KDD 2020 [#Ting2020Isolation]_ `[PDF] `_, `[Code] `_
Deep Isolation Forest for Anomaly Detection TKDE 2023 [#Xu2023Deep]_ `[PDF] `_, `[Code] `_
================================================================================================= ============================ ===== ============================= ==============================================================================================================================================================================================
4.20. Emerging and Interesting Topics
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
================================================================================================= ============================ ===== ============================ ==========================================================================================================================================================================
Paper Title Venue Year Ref Materials
================================================================================================= ============================ ===== ============================ ==========================================================================================================================================================================
Clustering with Outlier Removal TKDE 2019 [#Liu2018Clustering]_ `[PDF] `_
Real-World Anomaly Detection by using Digital Twin Systems and Weakly-Supervised Learning IEEE Trans. Ind. Informat. 2020 [#Castellani2020Siamese]_ `[PDF] `_
SSD: A Unified Framework for Self-Supervised Outlier Detection ICLR 2021 [#Sehwag2021SSD]_ `[PDF] `_, `[Code] `_
================================================================================================= ============================ ===== ============================ ==========================================================================================================================================================================
----
5. Key Conferences/Workshops/Journals
-------------------------------------
5.1. Conferences & Workshops
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Key data mining conference **deadlines**, **historical acceptance rates**, and more
can be found `data-mining-conferences `_.
`ACM International Conference on Knowledge Discovery and Data Mining (SIGKDD) `_. **Note**: SIGKDD usually has an Outlier Detection Workshop (ODD), see `ODD 2021 `_.
`ACM International Conference on Management of Data (SIGMOD) `_
`The Web Conference (WWW) `_
`IEEE International Conference on Data Mining (ICDM) `_
`SIAM International Conference on Data Mining (SDM) `_
`IEEE International Conference on Data Engineering (ICDE) `_
`ACM InternationalConference on Information and Knowledge Management (CIKM) `_
`ACM International Conference on Web Search and Data Mining (WSDM) `_
`The European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML-PKDD) `_
`The Pacific-Asia Conference on Knowledge Discovery and Data Mining (PAKDD) `_
5.2. Journals
^^^^^^^^^^^^^
`ACM Transactions on Knowledge Discovery from Data (TKDD) `_
`IEEE Transactions on Knowledge and Data Engineering (TKDE) `_
`ACM SIGKDD Explorations Newsletter `_
`Data Mining and Knowledge Discovery `_
`Knowledge and Information Systems (KAIS) `_
----
References
----------
.. [#Abe2006Outlier] Abe, N., Zadrozny, B. and Langford, J., 2006, August. Outlier detection by active learning. In *Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining*, pp. 504-509, ACM.
.. [#Aggarwal2013Outlier] Aggarwal, C.C., 2013. Outlier ensembles: position paper. *ACM SIGKDD Explorations Newsletter*\ , 14(2), pp.49-58.
.. [#Ahmed2016A] Ahmed, M., Mahmood, A.N. and Islam, M.R., 2016. A survey of anomaly detection techniques in financial domain. *Future Generation Computer Systems*\ , 55, pp.278-288.
.. [#Ahmad2017Unsupervised] Ahmad, S., Lavin, A., Purdy, S. and Agha, Z., 2017. Unsupervised real-time anomaly detection for streaming data. *Neurocomputing*, 262, pp.134-147.
.. [#Akoglu2015Graph] Akoglu, L., Tong, H. and Koutra, D., 2015. Graph based anomaly detection and description: a survey. *Data Mining and Knowledge Discovery*\ , 29(3), pp.626-688.
.. [#Angiulli2002Fast] Angiulli, F. and Pizzuti, C., 2002, August. Fast outlier detection in high dimensional spaces. In *European Conference on Principles of Data Mining and Knowledge Discovery*, pp. 15-27.
.. [#Arnaldo2019ex2] Arnaldo, I., Veeramachaneni, K. and Lam, M., 2019. ex2: a framework for interactive anomaly detection. In *ACM IUI Workshop on Exploratory Search and Interactive Data Analytics (ESIDA)*.
.. [#Bahri2022automl] Bahri, M., Salutari, F., Putina, A. et al. AutoML: state of the art with a focus on anomaly detection, challenges, and research directions. *International Journal of Data Science and Analytics* (2022).
.. [#Bandaragoda2018Isolation] Bandaragoda, Tharindu R., Kai Ming Ting, David Albrecht, Fei Tony Liu, Ye Zhu, and Jonathan R. Wells. "Isolation‐based anomaly detection using nearest‐neighbor ensembles." *Computational Intelligence* 34, no. 4 (2018): 968-998.
.. [#Bhatia2020MIDAS] Bhatia, S., Hooi, B., Yoon, M., Shin, K. and Faloutsos. C., 2020. MIDAS: Microcluster-Based Detector of Anomalies in Edge Streams. In *AAAI Conference on Artificial Intelligence (AAAI)*.
.. [#Braei2020Anomaly] Braei, M. and Wagner, S., 2020. Anomaly detection in univariate time-series: A survey on the state-of-the-art. arXiv preprint arXiv:2004.00433.
.. [#Breunig2000LOF] Breunig, M.M., Kriegel, H.P., Ng, R.T. and Sander, J., 2000, May. LOF: identifying density-based local outliers. *ACM SIGMOD Record*\ , 29(2), pp. 93-104.
.. [#Bulusu2020Deep] Bulusu, S., Kailkhura, B., Li, B., Varshney, P. and Song, D., 2020. Anomalous instance detection in deep learning: A survey (No. LLNL-CONF-808677). Lawrence Livermore National Lab.(LLNL), Livermore, CA (United States).
.. [#Campos2016On] Campos, G.O., Zimek, A., Sander, J., Campello, R.J., Micenková, B., Schubert, E., Assent, I. and Houle, M.E., 2016. On the evaluation of unsupervised outlier detection: measures, datasets, and an empirical study. *Data Mining and Knowledge Discovery*\ , 30(4), pp.891-927.
.. [#Campos2018An] Campos, G.O., Zimek, A. and Meira, W., 2018, June. An Unsupervised Boosting Strategy for Outlier Detection Ensembles. In *Pacific-Asia Conference on Knowledge Discovery and Data Mining (pp. 564-576)*. Springer, Cham.
.. [#Campos2019Outlier] Campos, G.O., Moreira, E., Meira Jr, W. and Zimek, A., 2019. Outlier Detection in Graphs: A Study on the Impact of Multiple Graph Models. *Computer Science & Information Systems*, 16(2).
.. [#Castellani2020Siamese] Castellani, A., Schmitt, S., Squartini, S., 2020. Real-World Anomaly Detection by using Digital Twin Systems and Weakly-Supervised Learning. In *IEEE Transactions on Industrial Informatics*.
.. [#Chalapathy2019Deep] Chalapathy, R. and Chawla, S., 2019. Deep learning for anomaly detection: A survey. arXiv preprint arXiv:1901.03407.
.. [#Chandola2009Anomaly] Chandola, V., Banerjee, A. and Kumar, V., 2009. Anomaly detection: A survey. *ACM computing surveys* , 41(3), p.15.
.. [#Chawla2011Anomaly] Chawla, S. and Chandola, V., 2011, Anomaly Detection: A Tutorial. *Tutorial at ICDM 2011*.
.. [#Chen2017Outlier] Chen, J., Sathe, S., Aggarwal, C. and Turaga, D., 2017, June. Outlier detection with autoencoder ensembles. *SIAM International Conference on Data Mining*, pp. 90-98. Society for Industrial and Applied Mathematics.
.. [#Dai2022Graph] Dai, E. and Chen, J., 2022. Graph-Augmented Normalizing Flows for Anomaly Detection of Multiple Time Series. International Conference on Learning Representations (ICLR).
.. [#Dang2014Discriminative] Dang, X.H., Assent, I., Ng, R.T., Zimek, A. and Schubert, E., 2014, March. Discriminative features for identifying and interpreting outliers. In *International Conference on Data Engineering (ICDE)*. IEEE.
.. [#Das2019Active] Das, S., Islam, M.R., Jayakodi, N.K. and Doppa, J.R., 2019. Active Anomaly Detection via Ensembles: Insights, Algorithms, and Interpretability. arXiv preprint arXiv:1901.08930.
.. [#Davidson2020A] Davidson, I. and Ravi, S.S., 2020. A framework for determining the fairness of outlier detection. In Proceedings of the 24th European Conference on Artificial Intelligence (ECAI2020) (Vol. 2029).
.. [#Ding2019Interactive] Ding, K., Li, J. and Liu, H., 2019, January. Interactive anomaly detection on attributed networks. In *Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining*, pp. 357-365. ACM.
.. [#Djenouri2018Outlier] Djenouri, Y. and Zimek, A., 2018, June. Outlier detection in urban traffic data. In *Proceedings of the 8th International Conference on Web Intelligence, Mining and Semantics*. ACM.
.. [#Domingues2018A] Domingues, R., Filippone, M., Michiardi, P. and Zouaoui, J., 2018. A comparative evaluation of outlier detection algorithms: Experiments and analyses. *Pattern Recognition*, 74, pp.406-421.
.. [#Emmott2015A] Emmott, A., Das, S., Dietterich, T., Fern, A. and Wong, W.K., 2015. A meta-analysis of the anomaly detection problem. arXiv preprint arXiv:1503.01158.
.. [#Ergen2019Unsupervised] Ergen, T. and Kozat, S.S., 2019. Unsupervised Anomaly Detection With LSTM Neural Networks. *IEEE transactions on neural networks and learning systems*.
.. [#Falcao2019Quantitative] Falcão, F., Zoppi, T., Silva, C.B.V., Santos, A., Fonseca, B., Ceccarelli, A. and Bondavalli, A., 2019, April. Quantitative comparison of unsupervised anomaly detection algorithms for intrusion detection. In *Proceedings of the 34th ACM/SIGAPP Symposium on Applied Computing*, (pp. 318-327). ACM.
.. [#GarciaTeodoro2009Anomaly] Garcia-Teodoro, P., Diaz-Verdejo, J., Maciá-Fernández, G. and Vázquez, E., 2009. Anomaly-based network intrusion detection: Techniques, systems and challenges. *Computers & Security*\ , 28(1-2), pp.18-28.
.. [#Goldstein2016A] Goldstein, M. and Uchida, S., 2016. A comparative evaluation of unsupervised anomaly detection algorithms for multivariate data. *PloS one*\ , 11(4), p.e0152173.
.. [#Gupta2014Outlier] Gupta, M., Gao, J., Aggarwal, C.C. and Han, J., 2014. Outlier detection for temporal data: A survey. *IEEE Transactions on Knowledge and Data Engineering*\ , 26(9), pp.2250-2267.
.. [#Hariri2019Extended] Hariri, S., Kind, M.C. and Brunner, R.J., 2019. Extended Isolation Forest. *IEEE Transactions on Knowledge and Data Engineering*.
.. [#Hendrycks2019Deep] Hendrycks, D., Mazeika, M. and Dietterich, T.G., 2019. Deep Anomaly Detection with Outlier Exposure. International Conference on Learning Representations (ICLR).
.. [#Hodge2004A] Hodge, V. and Austin, J., 2004. A survey of outlier detection methodologies. *Artificial intelligence review*\ , 22(2), pp.85-126.
.. [#Hojjati2022Self] Hojjati, H., Ho, T.K.K. and Armanfard, N., 2022. Self-Supervised Anomaly Detection: A Survey and Outlook. arXiv preprint arXiv:2205.05173.
.. [#Hundman2018Detecting] Hundman, K., Constantinou, V., Laporte, C., Colwell, I. and Soderstrom, T., 2018, July. Detecting spacecraft anomalies using lstms and nonparametric dynamic thresholding. In *Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining*, (pp. 387-395). ACM.
.. [#Kannan2017Outlier] Kannan, R., Woo, H., Aggarwal, C.C. and Park, H., 2017, June. Outlier detection for text data. In *Proceedings of the 2017 SIAM International Conference on Data Mining*, pp. 489-497. Society for Industrial and Applied Mathematics.
.. [#Kriegel2010Outlier] Kriegel, H.P., Kröger, P. and Zimek, A., 2010. Outlier detection techniques. *Tutorial at ACM SIGKDD 2010*.
.. [#Jiang2023adgym] Jiang, M., Hou, C., Zheng, A., Han, S., Huang, H., Wen, Q., Hu, X. and Zhao, Y., 2023. ADGym: Design Choices for Deep Anomaly Detection. *NeurIPS*, Datasets and Benchmarks Track.
.. [#Jiang2023weakly] Jiang, M., Hou, C., Zheng, A., Hu, X., Han, S., Huang, H., He, X., Yu, P.S. and Zhao, Y., 2023. Weakly supervised anomaly detection: A survey. arXiv preprint arXiv:2302.04549.
.. [#Lai2021Revisiting] Lai, K.H., Zha, D., Xu, J., Zhao, Y., Wang, G. and Hu, X., 2021. Revisiting Time Series Outlier Detection: Definitions and Benchmarks. *NeurIPS*, Datasets and Benchmarks Track.
.. [#Lamba2019Learning] Lamba, H. and Akoglu, L., 2019, May. Learning On-the-Job to Re-rank Anomalies from Top-1 Feedback. In *Proceedings of the 2019 SIAM International Conference on Data Mining (SDM)*, pp. 612-620. Society for Industrial and Applied Mathematics.
.. [#Lavin2015Evaluating] Lavin, A. and Ahmad, S., 2015, December. Evaluating Real-Time Anomaly Detection Algorithms--The Numenta Anomaly Benchmark. In *2015 IEEE 14th International Conference on Machine Learning and Applications (ICMLA)* (pp. 38-44). IEEE.
.. [#Lazarevic2008Data] Lazarevic, A., Banerjee, A., Chandola, V., Kumar, V. and Srivastava, J., 2008, September. Data mining for anomaly detection. *Tutorial at ECML PKDD 2008*.
.. [#Li2019MAD] Li, D., Chen, D., Jin, B., Shi, L., Goh, J. and Ng, S.K., 2019, September. MAD-GAN: Multivariate anomaly detection for time series data with generative adversarial networks. In *International Conference on Artificial Neural Networks* (pp. 703-716). Springer, Cham.
.. [#Li2020COPOD] Li, Z., Zhao, Y., Botta, N., Ionescu, C. and Hu, X. COPOD: Copula-Based Outlier Detection. *IEEE International Conference on Data Mining (ICDM)*, 2020.
.. [#Li2021ECOD] Li, Z., Zhao, Y., Hu, X., Botta, N., Ionescu, C. and Chen, H. G. ECOD: Unsupervised Outlier Detection Using Empirical Cumulative Distribution Functions. *IEEE Transactions on Knowledge and Data Engineering (TKDE)*, 2022.
.. [#Li2023XAD] Li, Z., Zhu, Y. and Van Leeuwen, M., 2023. A survey on explainable anomaly detection. *ACM Transactions on Knowledge Discovery from Data*, 18(1), pp.1-54.
.. [#Li2023QCAD] Li, Z. and Van Leeuwen, M., 2023. Explainable contextual anomaly detection using quantile regression forests. *Data Mining and Knowledge Discovery*, 37(6), pp.2517-2563.
.. [#Liu2008Isolation] Liu, F.T., Ting, K.M. and Zhou, Z.H., 2008, December. Isolation forest. In *International Conference on Data Mining*\ , pp. 413-422. IEEE.
.. [#Liu2018Clustering] Liu, H., Li, J., Wu, Y. and Fu, Y., 2019. Clustering with outlier removal. *IEEE transactions on knowledge and data engineering*.
.. [#Liu2018Contextual] Liu, N., Shin, D. and Hu, X., 2017. Contextual outlier interpretation. In *International Joint Conference on Artificial Intelligence (IJCAI-18)*, pp.2461-2467.
.. [#Liu2019Generative] Liu, Y., Li, Z., Zhou, C., Jiang, Y., Sun, J., Wang, M. and He, X., 2019. Generative Adversarial Active Learning for Unsupervised Outlier Detection. *IEEE transactions on knowledge and data engineering*.
.. [#Li2020AutoOD] Li, Y., Chen, Z., Zha, D., Zhou, K., Jin, H., Chen, H. and Hu, X., 2020. AutoOD: Automated Outlier Detection via Curiosity-guided Search and Self-imitation Learning. *ICDE*.
.. [#Liu2022Benchmarking] Liu, K., Dou, Y., Zhao, Y., Ding, X., Hu, X., Zhang, R., Ding, K., Chen, C., Peng, H., Shu, K., Sun, L., Li, J., Chen, G.H., Jia, Z., and Yu, P.S. 2022. Benchmarking Node Outlier Detection on Graphs. arXiv preprint arXiv:2206.10071.
.. [#Ma2021A] Ma, X., Wu, J., Xue, S., Yang, J., Zhou, C., Sheng, Q.Z., Xiong, H. and Akoglu, L., 2021. A comprehensive survey on graph anomaly detection with deep learning. *IEEE Transactions on Knowledge and Data Engineering*.
.. [#Macha2018Explaining] Macha, M. and Akoglu, L., 2018. Explaining anomalies in groups with characterizing subspace rules. Data Mining and Knowledge Discovery, 32(5), pp.1444-1480.
.. [#Manzoor2018Outlier] Manzoor, E., Lamba, H. and Akoglu, L. Outlier Detection in Feature-Evolving Data Streams. In *24th ACM SIGKDD International Conference on Knowledge Discovery and Data mining (KDD)*. 2018.
.. [#Mendiratta2017Anomaly] Mendiratta, B.V., 2017. Anomaly Detection in Networks. *Tutorial at ACM SIGKDD 2017*.
.. [#Micenkova2015Learning] Micenková, B., McWilliams, B. and Assent, I., 2015. Learning representations for outlier detection on a budget. arXiv preprint arXiv:1507.08104.
.. [#Gupta2018Beyond] Gupta, N., Eswaran, D., Shah, N., Akoglu, L. and Faloutsos, C., Beyond Outlier Detection: LookOut for Pictorial Explanation. *ECML PKDD 2018*.
.. [#Han2022Adbench] Han, S., Hu, X., Huang, H., Jiang, M. and Zhao, Y., 2022. ADBench: Anomaly Detection Benchmark. arXiv preprint arXiv:2206.09426.
.. [#Pang2016Unsupervised] Pang, G., Cao, L., Chen, L. and Liu, H., 2016, December. Unsupervised feature selection for outlier detection by modelling hierarchical value-feature couplings. In Data Mining (ICDM), 2016 IEEE 16th International Conference on (pp. 410-419). IEEE.
.. [#Pang2017Learning] Pang, G., Cao, L., Chen, L. and Liu, H., 2017, August. Learning homophily couplings from non-iid data for joint feature selection and noise-resilient outlier detection. In Proceedings of the 26th International Joint Conference on Artificial Intelligence (pp. 2585-2591). AAAI Press.
.. [#Pang2018Learning] Pang, G., Cao, L., Chen, L. and Liu, H., 2018. Learning Representations of Ultrahigh-dimensional Data for Random Distance-based Outlier Detection. In *24th ACM SIGKDD International Conference on Knowledge Discovery and Data mining (KDD)*. 2018.
.. [#Pang2020Deep] Pang, G., Shen, C., Cao, L. and Hengel, A.V.D., 2021. Deep Learning for Anomaly Detection: A Review. ACM Computing Surveys (CSUR), 54(2), pp.1-38.
.. [#Pang2021Deep] Pang, G., Cao, L. and Aggarwal, C., 2021. Deep Learning for Anomaly Detection. *Tutorial at WSDM 2021*.
.. [#Pang2021Toward] Pang, G. and Aggarwal, C., 2021, August. Toward explainable deep anomaly detection. In *KDD* (pp. 4056-4057).
.. [#Pang2023recent] Guansong Pang, Joey Tianyi Zhou, Radu Tudor Ionescu, Yu Tian, and Kihyuk Sohn. "Recent Advances in Anomaly Detection". In: *CVPR'23*. Vancouver, Canada.
.. [#Pelleg2005Active] Pelleg, D. and Moore, A.W., 2005. Active learning for anomaly and rare-category detection. In *Advances in neural information processing systems*\, pp. 1073-1080.
.. [#Radovanovic2015Reverse] Radovanović, M., Nanopoulos, A. and Ivanović, M., 2015. Reverse nearest neighbors in unsupervised distance-based outlier detection. *IEEE transactions on knowledge and data engineering*, 27(5), pp.1369-1382.
.. [#Ramaswamy2000Efficient] Ramaswamy, S., Rastogi, R. and Shim, K., 2000, May. Efficient algorithms for mining outliers from large data sets. *ACM SIGMOD Record*\ , 29(2), pp. 427-438.
.. [#Ranshous2015Anomaly] Ranshous, S., Shen, S., Koutra, D., Harenberg, S., Faloutsos, C. and Samatova, N.F., 2015. Anomaly detection in dynamic networks: a survey. Wiley Interdisciplinary Reviews: Computational Statistics, 7(3), pp.223-247.
.. [#Ren2019Time] Ren, H., Xu, B., Wang, Y., Yi, C., Huang, C., Kou, X., Xing, T., Yang, M., Tong, J. and Zhang, Q., 2019. Time-Series Anomaly Detection Service at Microsoft. In *Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining*. ACM.
.. [#Riazi2019Detecting] Riazi, M., Zaiane, O., Takeuchi, T., Maltais, A., Günther, J. and Lipsett, M., Detecting the Onset of Machine Failure Using Anomaly Detection Methods.
.. [#Ro2015Outlier] Ro, K., Zou, C., Wang, Z. and Yin, G., 2015. Outlier detection for high-dimensional data. *Biometrika*, 102(3), pp.589-599.
.. [#Salehi2018A] Salehi, Mahsa & Rashidi, Lida. (2018). A Survey on Anomaly detection in Evolving Data: [with Application to Forest Fire Risk Prediction]. *ACM SIGKDD Explorations Newsletter*. 20. 13-23.
.. [#Salehi2021A] Salehi, M., Mirzaei, H., Hendrycks, D., Li, Y., Rohban, M.H., Sabokrou, M., 2021. A Unified Survey on Anomaly, Novelty, Open-Set, and Out-of-Distribution Detection: Solutions and Future Challenges. arXiv preprint arXiv:2110.14051.
.. [#Scholkopf2001Estimating] Schölkopf, B., Platt, J.C., Shawe-Taylor, J., Smola, A.J. and Williamson, R.C., 2001. Estimating the support of a high-dimensional distribution. *Neural Computation*, 13(7), pp.1443-1471.
.. [#Sehwag2021SSD] Sehwag, V., Chiang, M., Mittal, P., 2021. SSD: A Unified Framework for Self-Supervised Outlier Detection. *International Conference on Learning Representations (ICLR)*.
.. [#Shekhar2021FAIROD] Shekhar, S., Shah, N. and Akoglu, L., 2021. FAIROD: Fairness-aware Outlier Detection. AAAI/ACM Conference on AI, Ethics, and Society (AIES).
.. [#Siddiqui2019Sequential] Siddiqui, M.A., Fern, A., Dietterich, T.G. and Wong, W.K., 2019. Sequential Feature Explanations for Anomaly Detection. *ACM Transactions on Knowledge Discovery from Data (TKDD)*, 13(1), p.1.
.. [#Sperl2021A3] Sperl, P., Schulze, J.-P., and Böttinger, K., 2021. Activation Anomaly Analysis. *European Conference on Machine Learning and Data Mining (ECML-PKDD) 2020*.
.. [#Suri2019Research] Suri, N.R. and Athithan, G., 2019. Research Issues in Outlier Detection. In *Outlier Detection: Techniques and Applications*, pp. 29-51. Springer, Cham.
.. [#Tang2015Mining] Tang, G., Pei, J., Bailey, J. and Dong, G., 2015. Mining multidimensional contextual outliers from categorical relational data. *Intelligent Data Analysis*, 19(5), pp.1171-1192.
.. [#Tang2023GADBench] Tang, J., Hua, F., Gao, Z., Zhao, P. and Li, J., 2023. GADBench: Revisiting and Benchmarking Supervised Graph Anomaly Detection. *NeurIPS*, Datasets and Benchmarks Track.
.. [#Ting2018Which] Ting, KM., Aryal, S. and Washio, T., 2018, Which Anomaly Detector should I use? *Tutorial at ICDM 2018*.
.. [#Ting2020Isolation] Ting, Kai Ming, Bi-Cun Xu, Takashi Washio, and Zhi-Hua Zhou. "Isolation Distributional Kernel: A New Tool for Kernel based Anomaly Detection." In *Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining*, pp. 198-206. 2020.
.. [#Wang2019Effective] Wang, S., Zeng, Y., Liu, X., Zhu, E., Yin, J., Xu, C. and Kloft, M., 2019. Effective End-to-end Unsupervised Outlier Detection via Inlier Priority of Discriminative Network. In *33rd Conference on Neural Information Processing Systems*.
.. [#Wang2019Progress] Wang, H., Bah, M.J. and Hammad, M., 2019. Progress in Outlier Detection Techniques: A Survey. *IEEE Access*, 7, pp.107964-108000.
.. [#Wang2020Deep] Wang, R., Nie, K., Chang, Y. J., Gong, X., Wang, T., Yang, Y., Long, B., 2020. Deep Learning for Anomaly Detection. *Tutorial at KDD 2020*.
.. [#WellerFahy2015A] Weller-Fahy, D.J., Borghetti, B.J. and Sodemann, A.A., 2015. A survey of distance and similarity measures used within network intrusion anomaly detection. *IEEE Communications Surveys & Tutorials*\ , 17(1), pp.70-91.
.. [#Xu2021Beyond] Xu, H., Wang, Y., Jian, S., Huang, Z., Wang, Y., Liu, N. and Li, F., 2021, April. Beyond Outlier Detection: Outlier Interpretation by Attention-Guided Triplet Deviation Network. In *Proceedings of the Web Conference* 2021 (pp. 1328-1339).
.. [#Xu2023Deep] Xu, H., Pang, G., Wang, Y., Wang, Y., 2023. Deep Isolation Forest for Anomaly Detection. *IEEE Transactions on Knowledge and Data Engineering*.
.. [#Xu2023Fascinating] Xu, H., Wang, Y., Wei, J., Jian, S., Li, Y., Liu, N., 2023. Fascinating Supervisory Signals and Where to Find Them: Deep Anomaly Detection with Scale Learning. *International Conference on Machine Learning (ICML)*.
.. [#Yoon2019NETS] Yoon, S., Lee, J. G., & Lee, B. S., 2019. NETS: extremely fast outlier detection from a data stream via set-based processing. Proceedings of the VLDB Endowment, 12(11), 1303-1315.
.. [#Yoon2020STARE] Yoon, S., Lee, J. G., & Lee, B. S., 2020. Ultrafast local outlier detection from a data stream with stationary region skipping. In Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (pp. 1181-1191)
.. [#Yoon2021MDUAL] Yoon, S., Shin, Y., Lee, J. G., & Lee, B. S. (2021, June). Multiple dynamic outlier-detection from a data stream by exploiting duality of data and queries. In Proceedings of the 2021 International Conference on Management of Data (SIGMOD).
.. [#Yoon2022ARCUS] Yoon, S., Lee, Y., Lee, J.G. and Lee, B.S., 2022, August. Adaptive Model Pooling for Online Deep Anomaly Detection from a Complex Evolving Data Stream. In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (pp. 2347-2357).
.. [#Yu2015Glad] Yu, R., He, X. and Liu, Y., 2015. GLAD: group anomaly detection in social media analysis. *ACM Transactions on Knowledge Discovery from Data (TKDD)*\ , 10(2), p.18.
.. [#Yu2016A] Yu, R., Qiu, H., Wen, Z., Lin, C. and Liu, Y., 2016. A survey on social media anomaly detection. *ACM SIGKDD Explorations Newsletter*\ , 18(1), pp.1-14.
.. [#Yuan2024Trustworthy] Yuan, S., Xu, D. and Wu, X., 2024 Trustworthy Anomaly Detection. *Tutorial at SDM 2024*.
.. [#Zha2020Meta] Zha, D., Lai, K.H., Wan, M. and Hu, X., 2020. Meta-AAD: Active Anomaly Detection with Deep Reinforcement Learning. *ICDM*.
.. [#Zhao2018Xgbod] Zhao, Y. and Hryniewicki, M.K., 2018, July. XGBOD: improving supervised outlier detection with unsupervised representation learning. In *2018 International Joint Conference on Neural Networks (IJCNN)*. IEEE.
.. [#Zhao2019LSCP] Zhao, Y., Nasrullah, Z., Hryniewicki, M.K. and Li, Z., 2019, May. LSCP: Locally selective combination in parallel outlier ensembles. In *Proceedings of the 2019 SIAM International Conference on Data Mining (SDM)*, pp. 585-593. Society for Industrial and Applied Mathematics.
.. [#Zhao2019PYOD] Zhao, Y., Nasrullah, Z. and Li, Z., PyOD: A Python Toolbox for Scalable Outlier Detection. *Journal of Machine Learning Research*, 20, pp.1-7.
.. [#Zhao2020Automating] Zhao, Y., Rossi, R.A. and Akoglu, L., 2021. Automatic Unsupervised Outlier Model Selection. *Advances in Neural Information Processing Systems*.
.. [#Zhao2021SUOD] Zhao, Y., Hu, X., Cheng, C., Wang, C., Wan, C., Wang, W., Yang, J., Bai, H., Li, Z., Xiao, C. and Wang, Y., 2021. SUOD: Accelerating Large-scale Unsupervised Heterogeneous Outlier Detection. *Proceedings of Machine Learning and Systems (MLSys)*.
.. [#Zhao2021TOD] Zhao, Y., Chen, G.H. and Jia, Z., 2021. TOD: Tensor-based Outlier Detection. arXiv preprint arXiv:2110.14007.
.. [#Zhou2019AnomalyNet] Zhou, J.T., Du, J., Zhu, H., Peng, X., Liu, Y. and Goh, R.S.M., 2019. AnomalyNet: An anomaly detection network for video surveillance. *IEEE Transactions on Information Forensics and Security*.
.. [#Zhu2019Tripartite] Zhu, Y. and Yang, K., 2019. Tripartite Active Learning for Interactive Anomaly Discovery. *IEEE Access*.
.. [#Zimek2012A] Zimek, A., Schubert, E. and Kriegel, H.P., 2012. A survey on unsupervised outlier detection in high‐dimensional numerical data. *Statistical Analysis and Data Mining: The ASA Data Science Journal*\ , 5(5), pp.363-387.
.. [#Zimek2014Ensembles] Zimek, A., Campello, R.J. and Sander, J., 2014. Ensembles for unsupervised outlier detection: challenges and research questions a position paper. *ACM Sigkdd Explorations Newsletter*\ , 15(1), pp.11-22.
.. [#Zong2018Deep] Zong, B., Song, Q., Min, M.R., Cheng, W., Lumezanu, C., Cho, D. and Chen, H., 2018. Deep autoencoding gaussian mixture model for unsupervised anomaly detection. International Conference on Learning Representations (ICLR).
.. [#Wang2023Drift] Wang, C., Zhuang, Z., Qi, Q., Wang, J., Wang, X., Sun, H., & Liao, J. (2023). Drift doesn't matter: dynamic decomposition with diffusion reconstruction for unstable multivariate time series anomaly detection. Advances in Neural Information Processing Systems, 36.