Classification Matters: Improving Video Action Detection with Class-Specific Attention
Video action detection (VAD) aims to detect actors and classify their actions in a video. We figure that VAD suffers more from classification rather than localization of actors. Hence, we analyze how prevailing methods form features for classification and find that they prioritize actor regions, yet often overlooking the essential contextual information necessary for accurate classification. Accordingly, we propose to reduce the bias toward actor and encourage paying attention to the context that is relevant to each action class. By assigning a class-dedicated query to each action class, our model can dynamically determine where to focus for effective classification. The proposed model demonstrates superior performance on three challenging benchmarks with significantly fewer parameters and less computation.
Code (0)
등록된 구현이 없습니다.
Tasks
Action DetectionClassificationVideo Action DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Spot What Matters: Learning Context Using Graph Convolutional Networks for Weakly-Supervised Action Detection
The dominant paradigm in spatiotemporal action detection is to classify actions using spatiotemporal features learned by 2D or 3D Convolutional Networks. We argue that several actions are characterized by their context, …
Action DetectionHuman-Object Interaction DetectionOptical Flow EstimationWatch Only Once: An End-to-End Video Action Detection Framework
We propose an end-to-end pipeline, named Watch Once Only (WOO), for video action detection. Current methods either decouple video action detection task into separated stages of actor localization and action classific…
Action ClassificationAction DetectionClassificationVideo Action DetectionUntrimmed Video Classification for Activity Detection: submission to ActivityNet Challenge
Current state-of-the-art human activity recognition is focused on the classification of temporally trimmed videos in which only one action occurs per frame. We propose a simple, yet effective, method for the temporal det…
Action DetectionActivity DetectionActivity RecognitionBinary Classification+4VideoCapsuleNet: A Simplified Network for Action Detection
The recent advances in Deep Convolutional Neural Networks (DCNNs) have shown extremely good results for video human action classification, however, action detection is still a challenging problem. The current action dete…
Action ClassificationAction DetectionAction LocalizationAction Segmentation+4Sports Video: Fine-Grained Action Detection and Classification of Table Tennis Strokes from Videos for MediaEval 2021
Sports video analysis is a prevalent research topic due to the variety of application areas, ranging from multimedia intelligent devices with user-tailored digests up to analysis of athletes' performance. The Sports Vide…
Action DetectionFine-Grained Action Detection