Look Around for Anomalies: Weakly-Supervised Anomaly Detection via Context-Motion Relational Learning
Weakly-supervised Video Anomaly Detection is the task of detecting frame-level anomalies using video-level labeled training data. It is difficult to explore class representative features using minimal supervision of weak labels with a single backbone branch. Furthermore, in real-world scenarios, the boundary between normal and abnormal is ambiguous and varies depending on the situation. For example, even for the same motion of running person, the abnormality varies depending on whether the surroundings are a playground or a roadway. Therefore, our aim is to extract discriminative features by widening the relative gap between classes' features from a single branch. In the proposed Class-Activate Feature Learning (CLAV), the features are extracted as per the weights that are implicitly activated depending on the class, and the gap is then enlarged through relative distance learning. Furthermore, as the relationship between context and motion is important in order to identify the anomalies in complex and diverse scenes, we propose a Context--Motion Interrelation Module (CoMo), which models the relationship between the appearance of the surroundings and motion, rather than utilizing only temporal dependencies or motion information. The proposed method shows SOTA performance on four benchmarks including large-scale real-world datasets, and we demonstrate the importance of relational information by analyzing the qualitative results and generalization ability.
Code (0)
등록된 구현이 없습니다.
Tasks
Anomaly DetectionRelational ReasoningSupervised Anomaly DetectionVideo Anomaly DetectionWeakly-supervised Video Anomaly DetectionSimilar Papers 제목 키워드 기반
Dynamic Erasing Network Based on Multi-Scale Temporal Features for Weakly Supervised Video Anomaly Detection
The goal of weakly supervised video anomaly detection is to learn a detection model using only video-level labeled data. However, prior studies typically divide videos into fixed-length segments without considering the c…
Anomaly DetectionVideo Anomaly DetectionWeakly-supervised Video Anomaly DetectionTowards Open Set Video Anomaly Detection
Open Set Video Anomaly Detection (OpenVAD) aims to identify abnormal events from video data where both known anomalies and novel ones exist in testing. Unsupervised models learned solely from normal videos are applicable…
Anomaly DetectionMultiple Instance LearningTripletVideo Anomaly DetectionWeakly-Supervised Spatiotemporal Anomaly Detection
In this paper, we explore a weakly supervised method for anomaly detection. Since annotating videos is time-consuming, we only look at weak video-level labels during training. This means that given a video, we know that …
Anomaly DetectionRefineVAD: Semantic-Guided Feature Recalibration for Weakly Supervised Video Anomaly Detection
Weakly-Supervised Video Anomaly Detection aims to identify anomalous events using only video-level labels, balancing annotation efficiency with practical applicability. However, existing methods often oversimplify the an…
Weakly-supervised Video Anomaly DetectionWeakly-supervised anomaly detection for multimodal data distributions
Weakly-supervised anomaly detection can outperform existing unsupervised methods with the assistance of a very small number of labeled anomalies, which attracts increasing attention from researchers. However, existing we…
Anomaly DetectionSupervised Anomaly DetectionWeakly-supervised Anomaly Detection