Overlooked Video Classification in Weakly Supervised Video Anomaly Detection
Current weakly supervised video anomaly detection algorithms mostly use multiple instance learning (MIL) or their varieties. Almost all recent approaches focus on how to select the correct snippets for training to improve the performance. They overlook or do not realize the power of video classification in boosting the performance of anomaly detection. In this paper, we study explicitly the power of video classification supervision using a BERT or LSTM. With this BERT or LSTM, CNN features of all snippets of a video can be aggregated into a single feature which can be used for video classification. This simple yet powerful video classification supervision, combined into the MIL framework, brings extraordinary performance improvement on all three major video anomaly detection datasets. Particularly it improves the mean average precision (mAP) on the XD-Violence from SOTA 78.84\% to new 82.10\%. The source code is available at https://github.com/wjtan99/BERT_Anomaly_Video_Classification.
Code (1)
Tasks
AllAnomaly DetectionClassificationMultiple Instance LearningVideo ClassificationWeakly-supervised Video Anomaly DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
The Staged Knowledge Distillation in Video Classification: Harmonizing Student Progress by a Complementary Weakly Supervised Framework
In the context of label-efficient learning on video data, the distillation method and the structural design of the teacher-student architecture have a significant impact on knowledge distillation. However, the relationsh…
Knowledge DistillationPseudo LabelVideo ClassificationWeakly-supervised LearningP3IV: Probabilistic Procedure Planning from Instructional Videos with Weak Supervision
In this paper, we study the problem of procedure planning in instructional videos. Here, an agent must produce a plausible sequence of actions that can transform the environment from a given start to a desired goal state…
Exploring Denoised Cross-Video Contrast for Weakly-Supervised Temporal Action Localization
Weakly-supervised temporal action localization aims to localize actions in untrimmed videos with only video-level labels. Most existing methods address this problem with a "localization-by-classification" pipeline th…
Action LocalizationContrastive LearningDenoisingPseudo Label+3Probabilistic Vision-Language Representation for Weakly Supervised Temporal Action Localization
Weakly supervised temporal action localization (WTAL) aims to detect action instances in untrimmed videos using only video-level annotations. Since many existing works optimize WTAL models based on action classification …
Action ClassificationAction LocalizationContrastive LearningTemporal Action Localization+1Action Graphs: Weakly-supervised Action Localization with Graph Convolution Networks
We present a method for weakly-supervised action localization based on graph convolutions. In order to find and classify video time segments that correspond to relevant action classes, a system must be able to both ident…
Action LocalizationWeakly Supervised Action Localization