A Comprehensive Study of Deep Video Action Recognition
Video action recognition is one of the representative tasks for video understanding. Over the last decade, we have witnessed great advancements in video action recognition thanks to the emergence of deep learning. But we also encountered new challenges, including modeling long-range temporal information in videos, high computation costs, and incomparable results due to datasets and evaluation protocol variances. In this paper, we provide a comprehensive survey of over 200 existing papers on deep learning for video action recognition. We first introduce the 17 video action recognition datasets that influenced the design of models. Then we present video action recognition models in chronological order: starting with early attempts at adapting deep learning, then to the two-stream networks, followed by the adoption of 3D convolutional kernels, and finally to the recent compute-efficient models. In addition, we benchmark popular methods on several representative datasets and release code for reproducibility. In the end, we discuss open problems and shed light on opportunities for video action recognition to facilitate new research ideas.
Code (1)
Tasks
Action RecognitionDeep LearningTemporal Action LocalizationVideo UnderstandingSimilar Papers 제목 키워드 기반
The THUMOS Challenge on Action Recognition for Videos "in the Wild"
Automatically recognizing and localizing wide ranges of human actions has crucial importance for video understanding. Towards this goal, the THUMOS challenge was introduced in 2013 to serve as a benchmark for action reco…
Action ClassificationAction RecognitionGeneral ClassificationTemporal Action Localization+1Bag of Visual Words and Fusion Methods for Action Recognition: Comprehensive Study and Good Practice
Video based action recognition is one of the important and challenging problems in computer vision research. Bag of Visual Words model (BoVW) with local features has become the most popular method and obtained the state-…
Action RecognitionAction Recognition In VideosTemporal Action LocalizationA Comprehensive Review of Few-shot Action Recognition
Few-shot action recognition aims to address the high cost and impracticality of manually labeling complex and variable video data in action recognition. It requires accurately classifying human actions in videos using on…
Action RecognitionFew-Shot action recognitionFew Shot Action RecognitionFew-Shot Learning+6Visual WetlandBirds Dataset: Bird Species Identification and Behavior Recognition in Videos
The current biodiversity loss crisis makes animal monitoring a relevant field of study. In light of this, data collected through monitoring can provide essential insights, and information for decision-making aimed at pre…
Action RecognitionDecision MakingTemporal Action LocalizationBEAR: A Video Dataset For Fine-grained Behaviors Recognition Oriented with Action and Environment Factors
Behavior recognition is an important task in video representation learning. An essential aspect pertains to effective feature learning conducive to behavior recognition. Recently, researchers have started to study fine-g…
Representation Learning