Invariant Anomaly Detection under Distribution Shifts: A Causal Perspective
Anomaly detection (AD) is the machine learning task of identifying highly discrepant abnormal samples by solely relying on the consistency of the normal training samples. Under the constraints of a distribution shift, the assumption that training samples and test samples are drawn from the same distribution breaks down. In this work, by leveraging tools from causal inference we attempt to increase the resilience of anomaly detection models to different kinds of distribution shifts. We begin by elucidating a simple yet necessary statistical property that ensures invariant representations, which is critical for robust AD under both domain and covariate shifts. From this property, we derive a regularization term which, when minimized, leads to partial distribution invariance across environments. Through extensive experimental evaluation on both synthetic and real-world tasks, covering a range of six different AD methods, we demonstrated significant improvements in out-of-distribution performance. Under both covariate and domain shift, models regularized with our proposed term showed marked increased robustness. Code is available at: https://github.com/JoaoCarv/invariant-anomaly-detection.
Code (1)
Tasks
Anomaly DetectionCausal InferenceMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Disentangling Physical Parameters for Anomalous Sound Detection Under Domain Shifts
To develop a sound-monitoring system for machines, a method for detecting anomalous sound under domain shifts is proposed. A domain shift occurs when a machine's physical parameters change. Because a domain shift changes…
Anomaly DetectionDisentanglementUnsupervised Anomaly DetectionROADS: Robust Prompt-driven Multi-Class Anomaly Detection under Domain Shift
Recent advancements in anomaly detection have shifted focus towards Multi-class Unified Anomaly Detection (MUAD), offering more scalable and practical alternatives compared to traditional one-class-one-model approaches. …
Anomaly DetectionMulti-class Anomaly DetectionRobust Distribution Alignment for Industrial Anomaly Detection under Distribution Shift
Anomaly detection plays a crucial role in quality control for industrial applications. However, ensuring robustness under unseen domain shifts such as lighting variations or sensor drift remains a significant challenge. …
3D Anomaly DetectionAnomaly DetectionDomain AdaptationAnomaly Detection under Distribution Shift
Anomaly detection (AD) is a crucial machine learning task that aims to learn patterns from a set of normal training samples to identify abnormal samples in test data. Most existing AD studies assume that the training and…
Anomaly DetectionUnsupervised Anomaly Detection in Multivariate Time Series across Heterogeneous Domains
The widespread adoption of digital services, along with the scale and complexity at which they operate, has made incidents in IT operations increasingly more likely, diverse, and impactful. This has led to the rapid deve…
Anomaly DetectionBenchmarkingDomain GeneralizationTime Series+1