paper-with-me

Papers

Structural Teacher-Student Normality Learning for Multi-Class Anomaly Detection and Localization

2024-02-27 · Hanqiu Deng, Xingyu Li

Visual anomaly detection is a challenging open-set task aimed at identifying unknown anomalous patterns while modeling normal data. The knowledge distillation paradigm has shown remarkable performance in one-class anomaly detection by leveraging teacher-student network feature comparisons. However, extending this paradigm to multi-class anomaly detection introduces novel scalability challenges. In this study, we address the significant performance degradation observed in previous teacher-student models when applied to multi-class anomaly detection, which we identify as resulting from cross-class interference. To tackle this issue, we introduce a novel approach known as Structural Teacher-Student Normality Learning (SNL): (1) We propose spatial-channel distillation and intra-&inter-affinity distillation techniques to measure structural distance between the teacher and student networks. (2) We introduce a central residual aggregation module (CRAM) to encapsulate the normal representation space of the student network. We evaluate our proposed approach on two anomaly detection datasets, MVTecAD and VisA. Our method surpasses the state-of-the-art distillation-based algorithms by a significant margin of 3.9% and 1.5% on MVTecAD and 1.2% and 2.5% on VisA in the multi-class anomaly detection and localization tasks, respectively. Furthermore, our algorithm outperforms the current state-of-the-art unified models on both MVTecAD and VisA.

📄 PDF Abstract BibTeX arXiv:2402.17091

Code (0)

등록된 구현이 없습니다.

Tasks

Anomaly DetectionKnowledge DistillationMulti-class Anomaly Detection

Methods 이 논문이 사용한 방법론

Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Similar Papers 제목 키워드 기반

Dual-Modeling Decouple Distillation for Unsupervised Anomaly Detection

2024-08-07 · Xinyue Liu, Jianyuan Wang, Biao Leng, Shuo Zhang

Knowledge distillation based on student-teacher network is one of the mainstream solution paradigms for the challenging unsupervised Anomaly Detection task, utilizing the difference in representation capabilities of the …

Anomaly DetectionAnomaly LocalizationKnowledge DistillationUnsupervised Anomaly Detection

You've Got Two Teachers: Co-evolutionary Image and Report Distillation for Semi-supervised Anatomical Abnormality Detection in Chest X-ray

2023-07-18 · Jinghan Sun, Dong Wei, Zhe Xu, Donghuan Lu 외

Chest X-ray (CXR) anatomical abnormality detection aims at localizing and characterising cardiopulmonary radiological findings in the radiographs, which can expedite clinical workflow and reduce observational oversights.…

Anomaly DetectionPseudo Label

Remembering Normality: Memory-guided Knowledge Distillation for Unsupervised Anomaly Detection

2023-01-01 · ICCV 2023 10 · Zhihao Gu, Liang Liu, Xu Chen, Ran Yi 외

Knowledge distillation (KD) has been widely explored in unsupervised anomaly detection (AD). The student is assumed to constantly produce representations of typical patterns within trained data, named "normality", an…

Anomaly DetectionKnowledge DistillationUnsupervised Anomaly Detection

Transformaly -- Two (Feature Spaces) Are Better Than One

2021-12-08 · Matan Jacob Cohen, Shai Avidan

Anomaly detection is a well-established research area that seeks to identify samples outside of a predetermined distribution. An anomaly detection pipeline is comprised of two main stages: (1) feature extraction and (2) …

Anomaly DetectionVocal Bursts Valence Prediction

Student Helping Teacher: Teacher Evolution via Self-Knowledge Distillation

2021-10-01 · Zheng Li, Xiang Li, Lingfeng Yang, Jian Yang 외

Knowledge distillation usually transfers the knowledge from a pre-trained cumbersome teacher network to a compact student network, which follows the classical teacher-teaching-student paradigm. Based on this paradigm, pr…

Knowledge DistillationSelf-Knowledge Distillation