Anomaly Detection with Prototype-Guided Discriminative Latent Embeddings
Recent efforts towards video anomaly detection (VAD) try to learn a deep autoencoder to describe normal event patterns with small reconstruction errors. The video inputs with large reconstruction errors are regarded as anomalies at the test time. However, these methods sometimes reconstruct abnormal inputs well because of the powerful generalization ability of deep autoencoder. To address this problem, we present a novel approach for anomaly detection, which utilizes discriminative prototypes of normal data to reconstruct video frames. In this way, the model will favor the reconstruction of normal events and distort the reconstruction of abnormal events. Specifically, we use a prototype-guided memory module to perform discriminative latent embedding. We introduce a new discriminative criterion for the memory module, as well as a loss function correspondingly, which can encourage memory items to record the representative embeddings of normal data, i.e. prototypes. Besides, we design a novel two-branch autoencoder, which is composed of a future frame prediction network and an RGB difference generation network that share the same encoder. The stacked RGB difference contains motion information just like optical flow, so our model can learn temporal regularity. We evaluate the effectiveness of our method on three benchmark datasets and experimental results demonstrate the proposed method outperforms the state-of-the-art.
Code (0)
등록된 구현이 없습니다.
Tasks
Anomaly DetectionOptical Flow EstimationVideo Anomaly DetectionSimilar Papers 제목 키워드 기반
Distribution Prototype Diffusion Learning for Open-set Supervised Anomaly Detection
In Open-set Supervised Anomaly Detection (OSAD), the existing methods typically generate pseudo anomalies to compensate for the scarcity of observed anomaly samples, while overlooking critical priors of normal sam…
Anomaly DetectionSupervised Anomaly DetectionReconstruction-Shift Discrimination via Mask-Guided Latent Diffusion for Medical Anomaly Detection
Unsupervised medical anomaly detection learns normal anatomical patterns from healthy training images and identifies deviations at test time. Reconstruction-based and diffusion-based methods commonly use the difference b…
Anomaly DetectionUnsupervised Multi-View Visual Anomaly Detection via Progressive Homography-Guided Alignment
Unsupervised visual anomaly detection from multi-view images presents a significant challenge: distinguishing genuine defects from benign appearance variations caused by viewpoint changes. Existing methods, often designe…
Anomaly DetectionInterpretable Graph-Level Anomaly Detection via Contrast with Normal Prototypes
The task of graph-level anomaly detection (GLAD) is to identify anomalous graphs that deviate significantly from the majority of graphs in a dataset. While deep GLAD methods have shown promising performance, their black-…
Anomaly DetectionDiverse Normal Prototypes-Guided Contrastive Reconstruction for Medical Anomaly Detection
Anomaly detection in medical images is challenging due to limited annotations and the domain gap. Existing reconstruction-based methods often rely on frozen pre-trained encoders, restricting adaptation to domain-specific…
Representation LearningAnomaly Detection