paper-with-me

홈 › Papers

Prior Normality Prompt Transformer for Multi-class Industrial Image Anomaly Detection

2024-06-17 · Haiming Yao, Yunkang Cao, Wei Luo, Weihang Zhang, Wenyong Yu, Weiming Shen

Image anomaly detection plays a pivotal role in industrial inspection. Traditional approaches often demand distinct models for specific categories, resulting in substantial deployment costs. This raises concerns about multi-class anomaly detection, where a unified model is developed for multiple classes. However, applying conventional methods, particularly reconstruction-based models, directly to multi-class scenarios encounters challenges such as identical shortcut learning, hindering effective discrimination between normal and abnormal instances. To tackle this issue, our study introduces the Prior Normality Prompt Transformer (PNPT) method for multi-class image anomaly detection. PNPT strategically incorporates normal semantics prompting to mitigate the "identical mapping" problem. This entails integrating a prior normality prompt into the reconstruction process, yielding a dual-stream model. This innovative architecture combines normal prior semantics with abnormal samples, enabling dual-stream reconstruction grounded in both prior knowledge and intrinsic sample characteristics. PNPT comprises four essential modules: Class-Specific Normality Prompting Pool (CS-NPP), Hierarchical Patch Embedding (HPE), Semantic Alignment Coupling Encoding (SACE), and Contextual Semantic Conditional Decoding (CSCD). Experimental validation on diverse benchmark datasets and real-world industrial applications highlights PNPT's superior performance in multi-class industrial anomaly detection.

📄 PDF Abstract BibTeX arXiv:2406.11507

Code (0)

등록된 구현이 없습니다.

Tasks

Anomaly DetectionMulti-class Anomaly Detection

Methods 이 논문이 사용한 방법론

Residual Connection 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Adam 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Similar Papers 제목 키워드 기반

Fine-grained Abnormality Prompt Learning for Zero-shot Anomaly Detection

2024-10-14 · Jiawen Zhu, Yew-Soon Ong, Chunhua Shen, Guansong Pang

Current zero-shot anomaly detection (ZSAD) methods show remarkable success in prompting large pre-trained vision-language models to detect anomalies in a target dataset without using any dataset-specific training or demo…

Anomaly DetectionPrompt Learningzero-shot anomaly detection

GenerateCT: Text-Conditional Generation of 3D Chest CT Volumes

2023-05-25 · Ibrahim Ethem Hamamci, Sezgin Er, Anjany Sekuboyina, Enis Simsar 외

GenerateCT, the first approach to generating 3D medical imaging conditioned on free-form medical text prompts, incorporates a text encoder and three key components: a novel causal vision transformer for encoding 3D CT vo…

Computed Tomography (CT)Image GenerationLanguage ModellingLarge Language Model+3

Multi-Class Abnormality Classification in Video Capsule Endoscopy Using Deep Learning

2024-10-24 · Arnav Samal, Ranya Batsyas

This report outlines Team Seq2Cure's deep learning approach for the Capsule Vision 2024 Challenge, leveraging an ensemble of convolutional neural networks (CNNs) and transformer-based architectures for multi-class abnorm…

Multi-class Classification

Prompt-Enhanced Multiple Instance Learning for Weakly Supervised Video Anomaly Detection

2024-01-01 · CVPR 2024 1 · Junxi Chen, Liang Li, Li Su, Zheng-Jun Zha 외

Weakly-supervised Video Anomaly Detection (wVAD) aims to detect frame-level anomalies using only video-level labels in training. Due to the limitation of coarse-grained labels Multi-Instance Learning (MIL) is prevail…

Anomaly DetectionMultiple Instance LearningVideo Anomaly DetectionWeakly-supervised Video Anomaly Detection

VisualAD: Language-Free Zero-Shot Anomaly Detection via Vision Transformer

2026-03-09 · Yanning Hou, Peiyuan Li, Zirui Liu, Yitong Wang 외 arxiv

Zero-shot anomaly detection (ZSAD) requires detecting and localizing anomalies without access to target-class anomaly samples. Mainstream methods rely on vision-language models (VLMs) such as CLIP: they build hand-crafte…

Anomaly Detection