A Classifier-Based Approach to Multi-Class Anomaly Detection Applied to Astronomical Time-Series
Automating anomaly detection is an open problem in many scientific fields, particularly in time-domain astronomy, where modern telescopes generate millions of alerts per night. Currently, most anomaly detection algorithms for astronomical time-series rely either on hand-crafted features or on features generated through unsupervised representation learning, coupled with standard anomaly detection algorithms. In this work, we introduce a novel approach that leverages the latent space of a neural network classifier for anomaly detection. We then propose a new method called Multi-Class Isolation Forests (MCIF), which trains separate isolation forests for each class to derive an anomaly score for an object based on its latent space representation. This approach significantly outperforms a standard isolation forest when distinct clusters exist in the latent space. Using a simulated dataset emulating the Zwicky Transient Facility (54 anomalies and 12,040 common), our anomaly detection pipeline discovered $46\pm3$ anomalies ($\sim 85\%$ recall) after following up the top 2,000 ($\sim 15\%$) ranked objects. Furthermore, our classifier-based approach outperforms or approaches the performance of other state-of-the-art anomaly detection pipelines. Our novel method demonstrates that existing and new classifiers can be effectively repurposed for real-time anomaly detection. The code used in this work, including a Python package, is publicly available, https://github.com/Rithwik-G/AstroMCAD.
Code (1)
Tasks
Anomaly DetectionAstronomyMulti-class Anomaly DetectionRepresentation LearningTime SeriesSimilar Papers 제목 키워드 기반
A multi-stream deep neural network with late fuzzy fusion for real-world anomaly detection
Abnormal event detection in video is alternatively known as outlier detection, where machine learning can be highly effective. While testing an unknown video, the objective of such methods is to verify the video’s catego…
Abnormal Event Detection In VideoAnomaly DetectionAnomaly Detection In Surveillance VideosEvent Detection+3BAAF: Universal Transformation of One-Class Classifiers for Unsupervised Image Anomaly Detection
Detecting anomalies in images and video is an essential task for multiple real-world problems, including industrial inspection, computer-assisted diagnosis, and environmental monitoring. Anomaly detection is typically fo…
Unsupervised Anomaly DetectionA Classifier-Based Approach to Multi-Class Anomaly Detection for Astronomical Transients
Automating real-time anomaly detection is essential for identifying rare transients, with modern survey telescopes generating tens of thousands of alerts per night, and future telescopes, such as the Vera C. Rubin Observ…
Anomaly DetectionMulti-class Anomaly DetectionRepresentation LearningASE: Anomaly Scoring Based Ensemble Learning for Imbalanced Datasets
Nowadays, many classification algorithms have been applied to various industries to help them work out their problems met in real-life scenarios. However, in many binary classification tasks, samples in the minority clas…
Anomaly DetectionBinary ClassificationEnsemble LearningClassification of Anomalies in Telecommunication Network KPI Time Series
The increasing complexity and scale of telecommunication networks have led to a growing interest in automated anomaly detection systems. However, the classification of anomalies detected on network Key Performance Indica…
Anomaly ClassificationAnomaly DetectionClassificationTime Series