Timeception for Complex Action Recognition
This paper focuses on the temporal aspect for recognizing human activities in videos; an important visual cue that has long been undervalued. We revisit the conventional definition of activity and restrict it to Complex Action: a set of one-actions with a weak temporal pattern that serves a specific purpose. Related works use spatiotemporal 3D convolutions with fixed kernel size, too rigid to capture the varieties in temporal extents of complex actions, and too short for long-range temporal modeling. In contrast, we use multi-scale temporal convolutions, and we reduce the complexity of 3D convolutions. The outcome is Timeception convolution layers, which reasons about minute-long temporal patterns, a factor of 8 longer than best related works. As a result, Timeception achieves impressive accuracy in recognizing the human activities of Charades, Breakfast Actions, and MultiTHUMOS. Further, we demonstrate that Timeception learns long-range temporal dependencies and tolerate temporal extents of complex actions.
Code (3)
Tasks
Action ClassificationAction RecognitionLong-video Activity RecognitionVideo ClassificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Grounding Foundational Vision Models with 3D Human Poses for Robust Action Recognition
For embodied agents to effectively understand and interact within the world around them, they require a nuanced comprehension of human actions grounded in physical space. Current action recognition models, often relying …
Action RecognitionFacial Action Unit Recognition Based on Transfer Learning
Facial action unit recognition is an important task for facial analysis. Owing to the complex collection environment, facial action unit recognition in the wild is still challenging. The 3rd competition on affective beha…
Facial Action Unit DetectionTransfer LearningComplex-valued Iris Recognition Network
In this work, we design a fully complex-valued neural network for the task of iris recognition. Unlike the problem of general object recognition, where real-valued neural networks can be used to extract pertinent feature…
Iris RecognitionObject RecognitionA Review on Coarse to Fine-Grained Animal Action Recognition
This review provides an in-depth exploration of the field of animal action recognition, focusing on coarse-grained (CG) and fine-grained (FG) techniques. The primary aim is to examine the current state of research in ani…
Action RecognitionAnimal Action RecognitionFine-grained Action RecognitionTemporal Action LocalizationA Real-time Hand Gesture Recognition and Human-Computer Interaction System
In this project, we design a real-time human-computer interaction system based on hand gesture. The whole system consists of three components: hand detection, gesture recognition and human-computer interaction (HCI) base…
Gesture RecognitionHand DetectionHand Gesture RecognitionHand-Gesture Recognition