Improved Anomaly Detection by Using the Attention-Based Isolation Forest
A new modification of Isolation Forest called Attention-Based Isolation Forest (ABIForest) for solving the anomaly detection problem is proposed. It incorporates the attention mechanism in the form of the Nadaraya-Watson regression into the Isolation Forest for improving solution of the anomaly detection problem. The main idea underlying the modification is to assign attention weights to each path of trees with learnable parameters depending on instances and trees themselves. The Huber's contamination model is proposed to be used for defining the attention weights and their parameters. As a result, the attention weights are linearly depend on the learnable attention parameters which are trained by solving the standard linear or quadratic optimization problem. ABIForest can be viewed as the first modification of Isolation Forest, which incorporates the attention mechanism in a simple way without applying gradient-based algorithms. Numerical experiments with synthetic and real datasets illustrate outperforming results of ABIForest. The code of proposed algorithms is available.
Code (1)
Tasks
Anomaly DetectionSimilar Papers 제목 키워드 기반
Isolation Mondrian Forest for Batch and Online Anomaly Detection
We propose a new method, named isolation Mondrian forest (iMondrian forest), for batch and online anomaly detection. The proposed method is a novel hybrid of isolation forest and Mondrian forest which are existing method…
Anomaly DetectionEnsemble LearningOut-of-Distribution DetectionTiWS-iForest: Isolation Forest in Weakly Supervised and Tiny ML scenarios
Unsupervised anomaly detection tackles the problem of finding anomalies inside datasets without the labels availability; since data tagging is typically hard or expensive to obtain, such approaches have seen huge applica…
Anomaly DetectionUnsupervised Anomaly DetectionDetecting Anomalies Using Rotated Isolation Forest
The Isolation Forest (iForest), proposed by Liu, Ting, and Zhou at TKDE 2012, has become a prominent tool for unsupervised anomaly detection. However, recent research by Hariri, Kind, and Brunner, published in TKDE 2021,…
Anomaly DetectionUnsupervised Anomaly DetectionWhy Are You Weird? Infusing Interpretability in Isolation Forest for Anomaly Detection
Anomaly detection is concerned with identifying examples in a dataset that do not conform to the expected behaviour. While a vast amount of anomaly detection algorithms exist, little attention has been paid to explaining…
Anomaly DetectionAttributeOptIForest: Optimal Isolation Forest for Anomaly Detection
Anomaly detection plays an increasingly important role in various fields for critical tasks such as intrusion detection in cybersecurity, financial risk detection, and human health monitoring. A variety of anomaly detect…
Anomaly DetectionBenchmarkingIntrusion Detection