Self-supervise, Refine, Repeat: Improving Unsupervised Anomaly Detection
Anomaly detection (AD), separating anomalies from normal data, has many applications across domains, from security to healthcare. While most previous works were shown to be effective for cases with fully or partially labeled data, that setting is in practice less common due to labeling being particularly tedious for this task. In this paper, we focus on fully unsupervised AD, in which the entire training dataset, containing both normal and anomalous samples, is unlabeled. To tackle this problem effectively, we propose to improve the robustness of one-class classification trained on self-supervised representations using a data refinement process. Our proposed data refinement approach is based on an ensemble of one-class classifiers (OCCs), each of which is trained on a disjoint subset of training data. Representations learned by self-supervised learning on the refined data are iteratively updated as the data refinement improves. We demonstrate our method on various unsupervised AD tasks with image and tabular data. With a 10% anomaly ratio on CIFAR-10 image data / 2.5% anomaly ratio on Thyroid tabular data, the proposed method outperforms the state-of-the-art one-class classifier by 6.3 AUC and 12.5 average precision / 22.9 F1-score.
Code (0)
등록된 구현이 없습니다.
Tasks
Anomaly DetectionClassificationOne-Class ClassificationOne-class classifierSelf-Supervised LearningUnsupervised Anomaly DetectionSimilar Papers 제목 키워드 기반
DyAnNet: A Scene Dynamicity Guided Self-Trained Video Anomaly Detection Network
Unsupervised approaches for video anomaly detection may not perform as good as supervised approaches. However, learning unknown types of anomalies using an unsupervised approach is more practical than a supervised approa…
Anomaly DetectionVideo Anomaly DetectionSelf-Supervised Masking for Unsupervised Anomaly Detection and Localization
Recently, anomaly detection and localization in multimedia data have received significant attention among the machine learning community. In real-world applications such as medical diagnosis and industrial defect detecti…
Anomaly DetectionAnomaly LocalizationDefect DetectionMedical Diagnosis+2Unsupervised Anomaly Detectors to Detect Intrusions in the Current Threat Landscape
Anomaly detection aims at identifying unexpected fluctuations in the expected behavior of a given system. It is acknowledged as a reliable answer to the identification of zero-day attacks to such extent, several ML algor…
Anomaly DetectionBinary ClassificationClusteringIntrusion Detection+1Towards Unsupervised Object Detection From LiDAR Point Clouds
In this paper, we study the problem of unsupervised object detection from 3D point clouds in self-driving scenes. We present a simple yet effective method that exploits (i) point clustering in near-range areas where the …
Objectobject-detectionObject DetectionObject Discovery+1Anomaly Detection via Self-organizing Map
Anomaly detection plays a key role in industrial manufacturing for product quality control. Traditional methods for anomaly detection are rule-based with limited generalization ability. Recent methods based on supervised…
Anomaly DetectionUnsupervised Anomaly Detection