Updated version: A Video Anomaly Detection Framework based on Appearance-Motion Semantics Representation Consistency
Video anomaly detection is an essential but challenging task. The prevalent methods mainly investigate the reconstruction difference between normal and abnormal patterns but ignore the semantics consistency between appearance and motion information of behavior patterns, making the results highly dependent on the local context of frame sequences and lacking the understanding of behavior semantics. To address this issue, we propose a framework of Appearance-Motion Semantics Representation Consistency that uses the gap of appearance and motion semantic representation consistency between normal and abnormal data. The two-stream structure is designed to encode the appearance and motion information representation of normal samples, and a novel consistency loss is proposed to enhance the consistency of feature semantics so that anomalies with low consistency can be identified. Moreover, the lower consistency features of anomalies can be used to deteriorate the quality of the predicted frame, which makes anomalies easier to spot. Experimental results demonstrate the effectiveness of the proposed method.
Code (0)
등록된 구현이 없습니다.
Tasks
Anomaly DetectionVideo Anomaly DetectionSimilar Papers 제목 키워드 기반
Detection of Unknown Anomalies in Streaming Videos with Generative Energy-based Boltzmann Models
Abnormal event detection is one of the important objectives in research and practical applications of video surveillance. However, there are still three challenging problems for most anomaly detection systems in practica…
Anomaly DetectionClusteringEvent DetectionFeature Engineering+1Multi-branch Neural Networks for Video Anomaly Detection in Adverse Lighting and Weather Conditions
Automated anomaly detection in surveillance videos has attracted much interest as it provides a scalable alternative to manual monitoring. Most existing approaches achieve good performance on clean benchmark datasets rec…
Anomaly DetectionAnomaly Detection In Surveillance VideosVideo Anomaly DetectionExploiting Completeness and Uncertainty of Pseudo Labels for Weakly Supervised Video Anomaly Detection
Weakly supervised video anomaly detection aims to identify abnormal events in videos using only video-level labels. Recently, two-stage self-training methods have achieved significant improvements by self-generating pseu…
Anomaly DetectionDiversityPseudo LabelVideo Anomaly Detection+1Grid HTM: Hierarchical Temporal Memory for Anomaly Detection in Videos
The interest for video anomaly detection systems has gained traction for the past few years. The current approaches use deep learning to perform anomaly detection in videos, but this approach has multiple problems. For s…
Anomaly DetectionDeep LearningVideo Anomaly DetectionContracting Skeletal Kinematics for Human-Related Video Anomaly Detection
Detecting the anomaly of human behavior is paramount to timely recognizing endangering situations, such as street fights or elderly falls. However, anomaly detection is complex since anomalous events are rare and because…
Anomaly DetectionOpen Set LearningVideo Anomaly Detection