3D attention mechanism for fine-grained classification of table tennis strokes using a Twin Spatio-Temporal Convolutional Neural Networks
The paper addresses the problem of recognition of actions in video with low inter-class variability such as Table Tennis strokes. Two stream, "twin" convolutional neural networks are used with 3D convolutions both on RGB data and optical flow. Actions are recognized by classification of temporal windows. We introduce 3D attention modules and examine their impact on classification efficiency. In the context of the study of sportsmen performances, a corpus of the particular actions of table tennis strokes is considered. The use of attention blocks in the network speeds up the training step and improves the classification scores up to 5% with our twin model. We visualize the impact on the obtained features and notice correlation between attention and player movements and position. Score comparison of state-of-the-art action classification method and proposed approach with attentional blocks is performed on the corpus. Proposed model with attention blocks outperforms previous model without them and our baseline.
Code (0)
등록된 구현이 없습니다.
Tasks
Action ClassificationClassificationGeneral ClassificationOptical Flow EstimationSimilar Papers 제목 키워드 기반
Interpretable Attention Guided Network for Fine-grained Visual Classification
Fine-grained visual classification (FGVC) is challenging but more critical than traditional classification tasks. It requires distinguishing different subcategories with the inherently subtle intra-class object variation…
ClassificationFine-Grained Image ClassificationGeneral ClassificationMulti-grained Attention Network for Aspect-Level Sentiment Classification
We propose a novel multi-grained attention network (MGAN) model for aspect level sentiment classification. Existing approaches mostly adopt coarse-grained attention mechanism, which may bring information loss if the aspe…
Aspect-Based Sentiment Analysis (ABSA)ClassificationGeneral ClassificationSentiment Analysis+1DCNN: Dual Cross-current Neural Networks Realized Using An Interactive Deep Learning Discriminator for Fine-grained Objects
Accurate classification of fine-grained images remains a challenge in backbones based on convolutional operations or self-attention mechanisms. This study proposes novel dual-current neural networks (DCNN), which combine…
Fine-Grained Image Classificationimage-classificationImage ClassificationWeakly-supervised LearningTransfer Learning for Fine-grained Classification Using Semi-supervised Learning and Visual Transformers
Fine-grained classification is a challenging task that involves identifying subtle differences between objects within the same category. This task is particularly challenging in scenarios where data is scarce. Visual tra…
Classificationimage-classificationImage ClassificationTransfer LearningAn Attentive Neural Architecture for Fine-grained Entity Type Classification
In this work we propose a novel attention-based neural network model for the task of fine-grained entity type classification that unlike previously proposed models recursively composes representations of entity mention c…
ClassificationGeneral ClassificationVocal Bursts Type Prediction