paper-with-me

Papers

Toward Multi-class Anomaly Detection: Exploring Class-aware Unified Model against Inter-class Interference

2024-03-21 · Xi Jiang, Ying Chen, Qiang Nie, Jianlin Liu, Yong liu, Chengjie Wang, Feng Zheng

In the context of high usability in single-class anomaly detection models, recent academic research has become concerned about the more complex multi-class anomaly detection. Although several papers have designed unified models for this task, they often overlook the utility of class labels, a potent tool for mitigating inter-class interference. To address this issue, we introduce a Multi-class Implicit Neural representation Transformer for unified Anomaly Detection (MINT-AD), which leverages the fine-grained category information in the training stage. By learning the multi-class distributions, the model generates class-aware query embeddings for the transformer decoder, mitigating inter-class interference within the reconstruction model. Utilizing such an implicit neural representation network, MINT-AD can project category and position information into a feature embedding space, further supervised by classification and prior probability loss functions. Experimental results on multiple datasets demonstrate that MINT-AD outperforms existing unified training models.

📄 PDF Abstract BibTeX arXiv:2403.14213

Code (0)

등록된 구현이 없습니다.

Tasks

Anomaly DetectionDecoderMulti-class Anomaly Detection

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Multi-Head Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Similar Papers 제목 키워드 기반

Anomaly detection using Diffusion-based methods

2024-12-10 · Aryan Bhosale, Samrat Mukherjee, Biplab Banerjee, Fabio Cuzzolin

This paper explores the utility of diffusion-based models for anomaly detection, focusing on their efficacy in identifying deviations in both compact and high-resolution datasets. Diffusion-based architectures, including…

Anomaly DetectionDecoderDenoising

Towards Generic Anomaly Detection and Understanding: Large-scale Visual-linguistic Model (GPT-4V) Takes the Lead

2023-11-05 · Yunkang Cao, Xiaohao Xu, Chen Sun, Xiaonan Huang 외

Anomaly detection is a crucial task across different domains and data types. However, existing anomaly detection models are often designed for specific domains and modalities. This study explores the use of GPT-4V(ision)…

3D Anomaly DetectionAnomaly DetectionTime Series

MambaAD: Exploring State Space Models for Multi-class Unsupervised Anomaly Detection

2024-04-09 · Haoyang He, Yuhu Bai, Jiangning Zhang, Qingdong He 외

Recent advancements in anomaly detection have seen the efficacy of CNN- and transformer-based approaches. However, CNNs struggle with long-range dependencies, while transformers are burdened by quadratic computational co…

Anomaly DetectionDecoderLong-range modelingMamba+3

AnomalousPatchCore: Exploring the Use of Anomalous Samples in Industrial Anomaly Detection

2024-08-27 · Mykhailo Koshil, Tilman Wegener, Detlef Mentrup, Simone Frintrop 외

Visual inspection, or industrial anomaly detection, is one of the most common quality control types in manufacturing. The task is to identify the presence of an anomaly given an image, e.g., a missing component on an ima…

Anomaly Detectionimage-classificationImage Classification

Exploring the Use of Data-Driven Approaches for Anomaly Detection in the Internet of Things (IoT) Environment

2022-12-31 · Eleonora Achiluzzi, Menglu Li, Md Fahd Al Georgy, Rasha Kashef

The Internet of Things (IoT) is a system that connects physical computing devices, sensors, software, and other technologies. Data can be collected, transferred, and exchanged with other devices over the network without …

Anomaly DetectionDeep LearningSurvey