paper-with-me

Papers

Siamese Transition Masked Autoencoders as Uniform Unsupervised Visual Anomaly Detector

2022-11-01 · Haiming Yao, Xue Wang, Wenyong Yu

Unsupervised visual anomaly detection conveys practical significance in many scenarios and is a challenging task due to the unbounded definition of anomalies. Moreover, most previous methods are application-specific, and establishing a unified model for anomalies across application scenarios remains unsolved. This paper proposes a novel hybrid framework termed Siamese Transition Masked Autoencoders(ST-MAE) to handle various visual anomaly detection tasks uniformly via deep feature transition. Concretely, the proposed method first extracts hierarchical semantics features from a pre-trained deep convolutional neural network and then develops a feature decoupling strategy to split the deep features into two disjoint feature patch subsets. Leveraging the decoupled features, the ST-MAE is developed with the Siamese encoders that operate on each subset of feature patches and perform the latent representations transition of two subsets, along with a lightweight decoder that reconstructs the original feature from the transitioned latent representation. Finally, the anomalous attributes can be detected using the semantic deep feature residual. Our deep feature transition scheme yields a nontrivial and semantic self-supervisory task to extract prototypical normal patterns, which allows for learning uniform models that generalize well for different visual anomaly detection tasks. The extensive experiments conducted demonstrate that the proposed ST-MAE method can advance state-of-the-art performance on multiple benchmarks across application scenarios with a superior inference efficiency, which exhibits great potential to be the uniform model for unsupervised visual anomaly detection.

📄 PDF Abstract BibTeX arXiv:2211.00349

Code (0)

등록된 구현이 없습니다.

Tasks

Anomaly DetectionDecoder

Similar Papers 제목 키워드 기반

SiamJEPA: On the Role of Siamese Student Encoders in JEPA

2026-07-04 · Makoto Yamada hf

Recently, Joint Embedding Predictive Architectures (JEPAs) have attracted significant attention in the computer vision and machine learning communities as a promising framework for self-supervised representation learning…

Representation Learning

Siamese Masked Autoencoders

2023-05-23 · NeurIPS 2023 11

Establishing correspondence between images or scenes is a significant challenge in computer vision, especially given occlusions, viewpoint changes, and varying object appearances. In this paper, we present Siamese Masked…

Data AugmentationDecoderObjectSemantic Segmentation+2

Efficient Image Pre-Training with Siamese Cropped Masked Autoencoders

2024-03-26 · Alexandre Eymaël, Renaud Vandeghen, Anthony Cioppa, Silvio Giancola 외

Self-supervised pre-training of image encoders is omnipresent in the literature, particularly following the introduction of Masked autoencoders (MAE). Current efforts attempt to learn object-centric representations from …

ObjectSelf-Supervised Learning

ODDObjects: A Framework for Multiclass Unsupervised Anomaly Detection on Masked Objects

2021-04-26 · Ricky Ma

This paper presents a novel framework for unsupervised anomaly detection on masked objects called ODDObjects, which stands for Out-of-Distribution Detection on Objects. ODDObjects is designed to detect anomalies of vario…

Anomaly DetectionImage ReconstructionObject RecognitionOut-of-Distribution Detection+1

CL-MAE: Curriculum-Learned Masked Autoencoders

2023-08-31 · Neelu Madan, Nicolae-Catalin Ristea, Kamal Nasrollahi, Thomas B. Moeslund 외

Masked image modeling has been demonstrated as a powerful pretext task for generating robust representations that can be effectively generalized across multiple downstream tasks. Typically, this approach involves randoml…

Representation Learning