Patchwise Sparse Dictionary Learning from pre-trained Neural Network Activation Maps for Anomaly Detection in Images
In this work, we investigate a methodology to perform anomaly detection and localization on images. The method leverages both sparse representation learning and the adoption of a pre-trained neural network for classification purposes. The objective is to assess the effectiveness of the K-SVD sparse dictionary learning algorithm and understand the role of neural network activation maps as data descriptors. We extract meaningful representation features and build a sparse dictionary of the most expressive ones. The dictionary is built only over features coming from images without anomalies. Thus, images containing anomalies will either have a non-sparse representation as linear combinations of the dictionary elements or a high reconstruction error. We show that the proposed pipeline achieves state-of-the-art performance in terms of AUC-ROC score over benchmarks such as MVTec Anomaly Detection, Rd-MVTec Anomaly Detection, Magnetic Tiles Defect, and BeanTech Anomaly Detection Datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Anomaly DetectionDictionary LearningRepresentation LearningSimilar Papers 제목 키워드 기반
The Interpretable Dictionary in Sparse Coding
Artificial neural networks (ANNs), specifically deep learning networks, have often been labeled as black boxes due to the fact that the internal representation of the data is not easily interpretable. In our work, we ill…
Deep LearningPatchwise Joint Sparse Tracking with Occlusion Detection
This paper presents a robust tracking approach to handle challenges such as occlusion and appearance change. Here, the target is partitioned into a number of patches. Then, the appearance of each patch is modeled using a…
Dimensional Collapse in Transformer Attention Outputs: A Challenge for Sparse Dictionary Learning
Transformer architectures, and their attention mechanisms in particular, form the foundation of modern large language models. While transformer models are widely believed to operate in high-dimensional hidden spaces, we …
Group sparsity and geometry constrained dictionary learning for action recognition from depth maps.
Human action recognition based on the depth information provided by commodity depth sensors is an important yet challenging task. The noisy depth maps, different lengths of action sequences, and free styles in performing…
Action RecognitionDictionary LearningMultimodal Activity RecognitionTemporal Action LocalizationInterpreting Large Text-to-Image Diffusion Models with Dictionary Learning
Sparse autoencoders are a promising new approach for decomposing language model activations for interpretation and control. They have been applied successfully to vision transformer image encoders and to small-scale diff…
Dictionary LearningImage GenerationLanguage ModelingLanguage Modelling