Motion Part Regularization: Improving Action Recognition via Trajectory Selection
Dense local motion features such as dense trajectories have been widely used in action recognition. For most actions, only a few local features (e.g., critical movements of the hand, arm, leg etc.) are responsible to the action label. Therefore, discovering important motion part will lead to a more discriminative and compact action representation. Inspired by the recent advance in sentence regularization for text classification, we introduce a Motion Part Regularization framework to mining discriminative semi-local groups of dense trajectories. First, motion part candidates are generated by spatio-temporal grouping of densely sampled trajectories. Then, we develop a learning objective function which encourages sparse selection for these trajectory groups in conjunction with a discriminative term. We propose an alternative optimization algorithm to efficiently solve this objective function by introducing a set of auxiliary variables. The learned trajectory group weights are further utilized for weighted bag-of-feature representation for unknown action samples. The proposed motion part regularization framework achieves the state-of-the-art performances on several action recognition benchmarks.
Code (0)
등록된 구현이 없습니다.
Tasks
Action RecognitionSentenceTemporal Action Localizationtext-classificationText ClassificationSimilar Papers 제목 키워드 기반
Trokens: Semantic-Aware Relational Trajectory Tokens for Few-Shot Action Recognition
Video understanding requires effective modeling of both motion and appearance information, particularly for few-shot action recognition. While recent advances in point tracking have been shown to improve few-shot action …
Action RecognitionPoint TrackingTrajectory-aligned Space-time Tokens for Few-shot Action Recognition
We propose a simple yet effective approach for few-shot action recognition, emphasizing the disentanglement of motion and appearance representations. By harnessing recent progress in tracking, specifically point trajecto…
Action RecognitionDisentanglementFew-Shot action recognitionFew Shot Action Recognition+1Object Activity Scene Description, Construction and Recognition
Action recognition is a critical task for social robots to meaningfully engage with their environment. 3D human skeleton-based action recognition is an attractive research area in recent years. Although, the existing app…
Action RecognitionGeneral ClassificationObjectSkeleton Based Action Recognition+3Trajectory Convolution for Action Recognition
How to leverage the temporal dimension is a key question in video analysis. Recent works suggest an efficient approach to video feature learning, i.e., factorizing 3D convolutions into separate components respectively fo…
Action RecognitionTemporal Action LocalizationREFS: Robust EEG feature selection with missing multi-dimensional annotation for emotion recognition
The affective brain-computer interface is a crucial technology for affective interaction and emotional intelligence, emerging as a significant area of research in the human-computer interaction. Compared to single-type f…
Emotional IntelligenceEmotion Recognition