End-to-End Augmentation Hyperparameter Tuning for Self-Supervised Anomaly Detection
Self-supervised learning (SSL) has emerged as a promising paradigm that presents self-generated supervisory signals to real-world problems, bypassing the extensive manual labeling burden. SSL is especially attractive for unsupervised tasks such as anomaly detection, where labeled anomalies are often nonexistent and costly to obtain. While self-supervised anomaly detection (SSAD) has seen a recent surge of interest, the literature has failed to treat data augmentation as a hyperparameter. Meanwhile, recent works have reported that the choice of augmentation has significant impact on detection performance. In this paper, we introduce ST-SSAD (Self-Tuning Self-Supervised Anomaly Detection), the first systematic approach to SSAD in regards to rigorously tuning augmentation. To this end, our work presents two key contributions. The first is a new unsupervised validation loss that quantifies the alignment between the augmented training data and the (unlabeled) test data. In principle we adopt transduction, quantifying the extent to which augmentation mimics the true anomaly-generating mechanism, in contrast to augmenting data with arbitrary pseudo anomalies without regard to test data. Second, we present new differentiable augmentation functions, allowing data augmentation hyperparameter(s) to be tuned end-to-end via our proposed validation loss. Experiments on two testbeds with semantic class anomalies and subtle industrial defects show that systematically tuning augmentation offers significant performance gains over current practices.
Code (0)
등록된 구현이 없습니다.
Tasks
Anomaly DetectionData AugmentationSelf-Supervised Anomaly DetectionSelf-Supervised LearningSupervised Anomaly DetectionSimilar Papers 제목 키워드 기반
TSA on AutoPilot: Self-tuning Self-supervised Time Series Anomaly Detection
Time series anomaly detection (TSAD) finds many applications such as monitoring environmental sensors, industry KPIs, patient biomarkers, etc. A two-fold challenge for TSAD is a versatile and unsupervised model that can …
Anomaly DetectionData AugmentationTime SeriesTime Series Anomaly DetectionSelf-Supervision for Tackling Unsupervised Anomaly Detection: Pitfalls and Opportunities
Self-supervised learning (SSL) is a growing torrent that has recently transformed machine learning and its many real world applications, by learning on massive amounts of unlabeled data via self-generated supervisory sig…
Anomaly DetectionData AugmentationDensity EstimationModel Selection+2DSV: An Alignment Validation Loss for Self-supervised Outlier Model Selection
Self-supervised learning (SSL) has proven effective in solving various problems by generating internal supervisory signals. Unsupervised anomaly detection, which faces the high cost of obtaining true labels, is an area t…
Anomaly DetectionData AugmentationModel SelectionSelf-Supervised Learning+1Towards Automated Self-Supervised Learning for Truly Unsupervised Graph Anomaly Detection
Self-supervised learning (SSL) is an emerging paradigm that exploits supervisory signals generated from the data itself, and many recent studies have leveraged SSL to conduct graph anomaly detection. However, we empirica…
Anomaly DetectionGraph Anomaly DetectionSelf-Supervised LearningUnsupervised Anomaly DetectionData Augmentation is a Hyperparameter: Cherry-picked Self-Supervision for Unsupervised Anomaly Detection is Creating the Illusion of Success
Self-supervised learning (SSL) has emerged as a promising alternative to create supervisory signals to real-world problems, avoiding the extensive cost of manual labeling. SSL is particularly attractive for unsupervised …
Anomaly DetectionData AugmentationSelf-Supervised Anomaly DetectionSelf-Supervised Learning+1