Learning Memory-guided Normality for Anomaly Detection
We address the problem of anomaly detection, that is, detecting anomalous events in a video sequence. Anomaly detection methods based on convolutional neural networks (CNNs) typically leverage proxy tasks, such as reconstructing input video frames, to learn models describing normality without seeing anomalous samples at training time, and quantify the extent of abnormalities using the reconstruction error at test time. The main drawbacks of these approaches are that they do not consider the diversity of normal patterns explicitly, and the powerful representation capacity of CNNs allows to reconstruct abnormal video frames. To address this problem, we present an unsupervised learning approach to anomaly detection that considers the diversity of normal patterns explicitly, while lessening the representation capacity of CNNs. To this end, we propose to use a memory module with a new update scheme where items in the memory record prototypical patterns of normal data. We also present novel feature compactness and separateness losses to train the memory, boosting the discriminative power of both memory items and deeply learned features from normal data. Experimental results on standard benchmarks demonstrate the effectiveness and efficiency of our approach, which outperforms the state of the art.
Code (2)
Tasks
Anomaly DetectionAnomaly Detection In Surveillance VideosDiversityGeneral Action Video Anomaly DetectionPhysical Video Anomaly DetectionSimilar Papers 제목 키워드 기반
Remembering Normality: Memory-guided Knowledge Distillation for Unsupervised Anomaly Detection
Knowledge distillation (KD) has been widely explored in unsupervised anomaly detection (AD). The student is assumed to constantly produce representations of typical patterns within trained data, named "normality", an…
Anomaly DetectionKnowledge DistillationUnsupervised Anomaly DetectionObject-centric and memory-guided normality reconstruction for video anomaly detection
This paper addresses video anomaly detection problem for videosurveillance. Due to the inherent rarity and heterogeneity of abnormal events, the problem is viewed as a normality modeling strategy, in which our model lear…
Anomaly DetectionObjectVideo Anomaly DetectionExploring Multimodal Prompts For Unsupervised Continuous Anomaly Detection
Unsupervised Continuous Anomaly Detection (UCAD) is gaining attention for effectively addressing the catastrophic forgetting and heavy computational burden issues in traditional Unsupervised Anomaly Detection (UAD). Howe…
Unsupervised Anomaly DetectionAdversarial RobustnessInCTRLv2: Generalist Residual Models for Few-Shot Anomaly Detection and Segmentation
While recent anomaly detection (AD) methods have made substantial progress in recognizing abnormal patterns within specific domains, most of them are specialist models that are trained on large training samples from a sp…
Anomaly DetectionAppearance Blur-driven AutoEncoder and Motion-guided Memory Module for Video Anomaly Detection
Video anomaly detection (VAD) often learns the distribution of normal samples and detects the anomaly through measuring significant deviations, but the undesired generalization may reconstruct a few anomalies thus suppre…
Anomaly DetectionDomain AdaptationVideo Anomaly Detection