Visual Attribute-augmented Three-dimensional Convolutional Neural Network for Enhanced Human Action Recognition
Visual attributes in individual video frames, such as the presence of characteristic objects and scenes, offer substantial information for action recognition in videos. With individual 2D video frame as input, visual attributes extraction could be achieved effectively and efficiently with more sophisticated convolutional neural network than current 3D CNNs with spatio-temporal filters, thanks to fewer parameters in 2D CNNs. In this paper, the integration of visual attributes (including detection, encoding and classification) into multi-stream 3D CNN is proposed for action recognition in trimmed videos, with the proposed visual Attribute-augmented 3D CNN (A3D) framework. The visual attribute pipeline includes an object detection network, an attributes encoding network and a classification network. Our proposed A3D framework achieves state-of-the-art performance on both the HMDB51 and the UCF101 datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Action RecognitionAction Recognition In VideosAttributeGeneral Classificationobject-detectionObject DetectionTemporal Action LocalizationSimilar Papers 제목 키워드 기반
TransZero++: Cross Attribute-Guided Transformer for Zero-Shot Learning
Zero-shot learning (ZSL) tackles the novel class recognition problem by transferring semantic knowledge from seen classes to unseen ones. Existing attention-based models have struggled to learn inferior region features i…
AttributeDecoderZero-Shot LearningTransZero: Attribute-guided Transformer for Zero-Shot Learning
Zero-shot learning (ZSL) aims to recognize novel classes by transferring semantic knowledge from seen classes to unseen ones. Semantic knowledge is learned from attribute descriptions shared between different classes, wh…
AttributeDecoderZero-Shot LearningAST-GCN: Attribute-Augmented Spatiotemporal Graph Convolutional Network for Traffic Forecasting
Traffic forecasting is a fundamental and challenging task in the field of intelligent transportation. Accurate forecasting not only depends on the historical traffic flow information but also needs to consider the influe…
AttributeTraffic PredictionAttribute Prototype Network for Zero-Shot Learning
From the beginning of zero-shot learning research, visual attributes have been shown to play an important role. In order to better transfer attribute-based knowledge from known to unknown classes, we argue that an image …
AttributeRepresentation LearningZero-Shot LearningFace Synthesis from Visual Attributes via Sketch using Conditional VAEs and GANs
Automatic synthesis of faces from visual attributes is an important problem in computer vision and has wide applications in law enforcement and entertainment. With the advent of deep generative convolutional neural netwo…
AttributeFace Generation