Dual-Modeling Decouple Distillation for Unsupervised Anomaly Detection
Knowledge distillation based on student-teacher network is one of the mainstream solution paradigms for the challenging unsupervised Anomaly Detection task, utilizing the difference in representation capabilities of the teacher and student networks to implement anomaly localization. However, over-generalization of the student network to the teacher network may lead to negligible differences in representation capabilities of anomaly, thus affecting the detection effectiveness. Existing methods address the possible over-generalization by using differentiated students and teachers from the structural perspective or explicitly expanding distilled information from the content perspective, which inevitably result in an increased likelihood of underfitting of the student network and poor anomaly detection capabilities in anomaly center or edge. In this paper, we propose Dual-Modeling Decouple Distillation (DMDD) for the unsupervised anomaly detection. In DMDD, a Decouple Student-Teacher Network is proposed to decouple the initial student features into normality and abnormality features. We further introduce Dual-Modeling Distillation based on normal-anomaly image pairs, fitting normality features of anomalous image and the teacher features of the corresponding normal image, widening the distance between abnormality features and the teacher features in anomalous regions. Synthesizing these two distillation ideas, we achieve anomaly detection which focuses on both edge and center of anomaly. Finally, a Multi-perception Segmentation Network is proposed to achieve focused anomaly map fusion based on multiple attention. Experimental results on MVTec AD show that DMDD surpasses SOTA localization performance of previous knowledge distillation-based methods, reaching 98.85% on pixel-level AUC and 96.13% on PRO.
Code (0)
등록된 구현이 없습니다.
Tasks
Anomaly DetectionAnomaly LocalizationKnowledge DistillationUnsupervised Anomaly DetectionSimilar Papers 제목 키워드 기반
Exploring Dual Model Knowledge Distillation for Anomaly Detection
Unsupervised anomaly detection holds significant importance in large-scale industrial manufacturing. Recent methods have capitalized on the benefits of utilizing a classifier pretrained on natural images to extract repr…
Anomaly Detectionfeature selectionKnowledge Distillationmodel+1Dual-Student Knowledge Distillation Networks for Unsupervised Anomaly Detection
Due to the data imbalance and the diversity of defects, student-teacher networks (S-T) are favored in unsupervised anomaly detection, which explores the discrepancy in feature representation derived from the knowledge di…
Anomaly DetectionAnomaly SegmentationDiversityKnowledge Distillation+1Generalist Graph Anomaly Detection via Prototype-Based Distillation
Driven by the pressing demand for graph anomaly detection (GAD) in high-stakes domains, the generalist GAD paradigm, which trains a single detector transferable across new graphs, has recently gained growing attention. H…
Graph Anomaly DetectionGraph Neural NetworkDual Distillation for Few-Shot Anomaly Detection
Anomaly detection is a critical task in computer vision with profound implications for medical imaging, where identifying pathologies early can directly impact patient outcomes. While recent unsupervised anomaly detectio…
Unsupervised Anomaly DetectionJAPE: Joint Anomaly Prediction and Intrinsic Explanation in Multivariate Time Series
Multivariate time-series anomaly prediction aims to identify whether and when anomalies will occur over a future horizon from historical observations. Existing methods primarily characterize anomalies as deviations in fu…