Action Recognition With Motion Diversification and Dynamic Selection
Motion modeling is crucial in modern action recognition methods. As motion dynamics like moving tempos and action amplitude may vary a lot in different video clips, it poses great challenge on adaptively covering proper motion information. To address this issue, we introduce a Motion Diversification and Selection (MoDS) module to generate diversified spatio-temporal motion features and then select the suitable motion representation dynamically for categorizing the input video. To be specific, we first propose a spatio-temporal motion generation (StMG) module to construct a bank of diversified motion features with varying spatial neighborhood and time range. Then, a dynamic motion selection (DMS) module is leveraged to choose the most discriminative motion feature both spatially and temporally from the feature bank. As a result, our proposed method can make full use of the diversified spatio-temporal motion information, while maintaining computational efficiency at the inference stage. Extensive experiments on five widely-used benchmarks, demonstrate the effectiveness of the method and we achieve state-of-the-art performance on Something-Something V1 & V2 that are of large motion variation
Code (0)
등록된 구현이 없습니다.
Tasks
Action RecognitionComputational EfficiencyMotion GenerationSimilar Papers 제목 키워드 기반
Optimizing Speech Emotion Recognition using Manta-Ray Based Feature Selection
Emotion recognition from audio signals has been regarded as a challenging task in signal processing as it can be considered as a collection of static and dynamic classification tasks. Recognition of emotions from speech …
ClassificationEmotion Recognitionfeature selectionGeneral Classification+1Dynamic Modality and View Selection for Multimodal Emotion Recognition with Missing Modalities
The study of human emotions, traditionally a cornerstone in fields like psychology and neuroscience, has been profoundly impacted by the advent of artificial intelligence (AI). Multiple channels, such as speech (voice) a…
Emotion RecognitionMultimodal Emotion RecognitionPMI Sampler: Patch Similarity Guided Frame Selection for Aerial Action Recognition
We present a new algorithm for selection of informative frames in video action recognition. Our approach is designed for aerial videos captured using a moving camera where human actors occupy a small spatial resolution o…
Action RecognitionTemporal Action LocalizationPortfolio diversification and model uncertainty: a robust dynamic mean-variance approach
This paper focuses on a dynamic multi-asset mean-variance portfolio selection problem under model uncertainty. We develop a continuous time framework for taking into account ambiguity aversion about both expected return …
A Unified Model Selection Technique for Spectral Clustering Based Motion Segmentation
Motion segmentation is a fundamental problem in computer vision and is crucial in various applications such as robotics, autonomous driving and action recognition. Recently, spectral clustering based methods have shown i…
Action RecognitionAutonomous DrivingClusteringModel Selection+2