Three-Stream Convolutional Neural Network With Multi-Task and Ensemble Learning for 3D Action Recognition
In this paper, we propose a three-stream convolutional neural network (3SCNN) for action recognition from skeleton sequences, which aims to thoroughly and fully exploit the skeleton data by extracting, learning, fusing and inferring multiple motion-related features, including 3D joint positions and joint displacements across adjacent frames as well as oriented bone segments. The proposed 3SCNN involves three sequential stages. The first stage enriches three independently extracted features by co-occurrence feature learning. The second stage involves multi-channel pairwise fusion to take advantage of the complementary and diverse nature among three features. The third stage is a multi-task and ensemble learning network to further improve the generalization ability of 3SCNN. Experimental results on the standard dataset show the effectiveness of our proposed multi-stream feature learning, fusion and inference method for skeleton-based 3D action recognition.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Action RecognitionAction RecognitionEnsemble LearningSkeleton Based Action RecognitionSimilar Papers 제목 키워드 기반
EEG-Based Speech Decoding: A Novel Approach Using Multi-Kernel Ensemble Diffusion Models
In this study, we propose an ensemble learning framework for electroencephalogram-based overt speech classification, leveraging denoising diffusion probabilistic models with varying convolutional kernel sizes. The ensemb…
Brain Computer InterfaceDenoisingEEGEnsemble LearningA Baseline for Multi-Label Image Classification Using An Ensemble of Deep Convolutional Neural Networks
Recent studies on multi-label image classification have focused on designing more complex architectures of deep neural networks such as the use of attention mechanisms and region proposal networks. Although performance g…
ClassificationData AugmentationGeneral Classificationimage-classification+3Ensembles of feedforward-designed convolutional neural networks
An ensemble method that fuses the output decision vectors of multiple feedforward-designed convolutional neural networks (FF-CNNs) to solve the image classification problem is proposed in this work. To enhance the perfor…
DiversityGeneral Classificationimage-classificationImage ClassificationAn Ensemble of Simple Convolutional Neural Network Models for MNIST Digit Recognition
We report that a very high accuracy on the MNIST test set can be achieved by using simple convolutional neural network (CNN) models. We use three different models with 3x3, 5x5, and 7x7 kernel size in the convolution lay…
image-classificationImage ClassificationTranslationInvestigation of Ensemble features of Self-Supervised Pretrained Models for Automatic Speech Recognition
Self-supervised learning (SSL) based models have been shown to generate powerful representations that can be used to improve the performance of downstream speech tasks. Several state-of-the-art SSL models are available, …
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Self-Supervised Learningspeech-recognition+1