Unsupervised Transfer Learning for Anomaly Detection: Application to Complementary Operating Condition Transfer
Anomaly Detectors are trained on healthy operating condition data and raise an alarm when the measured samples deviate from the training data distribution. This means that the samples used to train the model should be sufficient in quantity and representative of the healthy operating conditions. But for industrial systems subject to changing operating conditions, acquiring such comprehensive sets of samples requires a long collection period and delay the point at which the anomaly detector can be trained and put in operation. A solution to this problem is to perform unsupervised transfer learning (UTL), to transfer complementary data between different units. In the literature however, UTL aims at finding common structure between the datasets, to perform clustering or dimensionality reduction. Yet, the task of transferring and combining complementary training data has not been studied. Our proposed framework is designed to transfer complementary operating conditions between different units in a completely unsupervised way to train more robust anomaly detectors. It differs, thereby, from other unsupervised transfer learning works as it focuses on a one-class classification problem. The proposed methodology enables to detect anomalies in operating conditions only experienced by other units. The proposed end-to-end framework uses adversarial deep learning to ensure alignment of the different units' distributions. The framework introduces a new loss, inspired by a dimensionality reduction tool, to enforce the conservation of the inherent variability of each dataset, and uses state-of-the art once-class approach to detect anomalies. We demonstrate the benefit of the proposed framework using three open source datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Anomaly DetectionClusteringDimensionality ReductionDomain AdaptationOne-Class ClassificationTransfer LearningUnsupervised Domain AdaptationSimilar Papers 제목 키워드 기반
Transfer Learning from an Auxiliary Discriminative Task for Unsupervised Anomaly Detection
Unsupervised anomaly detection from high dimensional data like mobility networks is a challenging task. Study of different approaches of feature engineering from such high dimensional data have been a focus of research i…
Anomaly DetectionFeature EngineeringGeneral ClassificationTransfer Learning+1An Open-Access Benchmark of Statistical and Machine-Learning Anomaly Detection Methods for Battery Applications
Battery safety is critical in applications ranging from consumer electronics to electric vehicles and aircraft, where undetected anomalies could trigger safety hazards or costly downtime. In this study, we present OSBAD …
Unsupervised Anomaly DetectionFeature EngineeringLabel-Efficient Interactive Time-Series Anomaly Detection
Time-series anomaly detection is an important task and has been widely applied in the industry. Since manual data annotation is expensive and inefficient, most applications adopt unsupervised anomaly detection methods, b…
Active LearningAnomaly DetectionTime SeriesTime Series Analysis+2Importance Weighted Adversarial Discriminative Transfer for Anomaly Detection
Previous transfer methods for anomaly detection generally assume the availability of labeled data in source or target domains. However, such an assumption is not valid in most real applications where large-scale labeled …
Anomaly DetectionvalidAnalyzing Shapley Additive Explanations to Understand Anomaly Detection Algorithm Behaviors and Their Complementarity
Unsupervised anomaly detection is a challenging problem due to the diversity of data distributions and the lack of labels. Ensemble methods are often adopted to mitigate these challenges by combining multiple detectors, …
Unsupervised Anomaly DetectionEnsemble Learning