paper-with-me

Papers

CAINNFlow: Convolutional block Attention modules and Invertible Neural Networks Flow for anomaly detection and localization tasks

2022-06-04 · Ruiqing Yan, Fan Zhang, Mengyuan Huang, Wu Liu, Dongyu Hu, Jinfeng Li, Qiang Liu, Jinrong Jiang, Qianjin Guo, Linghan Zheng

Detection of object anomalies is crucial in industrial processes, but unsupervised anomaly detection and localization is particularly important due to the difficulty of obtaining a large number of defective samples and the unpredictable types of anomalies in real life. Among the existing unsupervised anomaly detection and localization methods, the NF-based scheme has achieved better results. However, the two subnets (complex functions) $s_{i}(u_{i})$ and $t_{i}(u_{i})$ in NF are usually multilayer perceptrons, which need to squeeze the input visual features from 2D flattening to 1D, destroying the spatial location relationship in the feature map and losing the spatial structure information. In order to retain and effectively extract spatial structure information, we design in this study a complex function model with alternating CBAM embedded in a stacked $3\times3$ full convolution, which is able to retain and effectively extract spatial structure information in the normalized flow model. Extensive experimental results on the MVTec AD dataset show that CAINNFlow achieves advanced levels of accuracy and inference efficiency based on CNN and Transformer backbone networks as feature extractors, and CAINNFlow achieves a pixel-level AUC of $98.64\%$ for anomaly detection in MVTec AD.

📄 PDF Abstract BibTeX arXiv:2206.01992

Code (0)

등록된 구현이 없습니다.

Tasks

Anomaly DetectionUnsupervised Anomaly Detection

Methods 이 논문이 사용한 방법론

How do i ask a question at Expedia?*AskExpertService To ask a question on Expedia, you can utilize their Help Center +1-888-829-0881, call customer service, use live chat, or reach out via social media. You can also find answers to…
Multi-Head Attention 설명 없음
Attention 설명 없음
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

Invertible Attention

2021-06-16 · Jiajun Zha, Yiran Zhong, Jing Zhang, Richard Hartley 외

Attention has been proved to be an efficient mechanism to capture long-range dependencies. However, so far it has not been deployed in invertible networks. This is due to the fact that in order to make a network invertib…

Image Reconstruction

Densely connected normalizing flows

2021-06-08 · NeurIPS 2021 12 · Matej Grcić, Ivan Grubišić, Siniša Šegvić

Normalizing flows are bijective mappings between inputs and latent representations with a fully factorized distribution. They are very attractive due to exact likelihood valuation and efficient sampling. However, their e…

Density EstimationImage Generation

Bringing together invertible UNets with invertible attention modules for memory-efficient diffusion models

2025-04-15 · Karan Jain, Mohammad Nayeem Teli

Diffusion models have recently gained state of the art performance on many image generation tasks. However, most models require significant computational resources to achieve this. This becomes apparent in the applicatio…

DenoisingGPUImage Generation

Generative Flows with Invertible Attentions

2021-06-07 · CVPR 2022 1 · Rhea Sanjay Sukthanker, Zhiwu Huang, Suryansh Kumar, Radu Timofte 외

Flow-based generative models have shown an excellent ability to explicitly learn the probability density function of data via a sequence of invertible transformations. Yet, learning attentions in generative flows remains…

Image Generation

DCANet: Learning Connected Attentions for Convolutional Neural Networks

2020-07-09 · Xu Ma, Jingda Guo, Sihai Tang, Zhinan Qiao 외

While self-attention mechanism has shown promising results for many vision tasks, it only considers the current features at a time. We show that such a manner cannot take full advantage of the attention mechanism. In thi…