EmbraceNet for Activity: A Deep Multimodal Fusion Architecture for Activity Recognition
Human activity recognition using multiple sensors is a challenging but promising task in recent decades. In this paper, we propose a deep multimodal fusion model for activity recognition based on the recently proposed feature fusion architecture named EmbraceNet. Our model processes each sensor data independently, combines the features with the EmbraceNet architecture, and post-processes the fused feature to predict the activity. In addition, we propose additional processes to boost the performance of our model. We submit the results obtained from our proposed model to the SHL recognition challenge with the team name "Yonsei-MCML."
Code (0)
등록된 구현이 없습니다.
Tasks
Activity RecognitionHuman Activity RecognitionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
EmbraceNet: A robust deep learning architecture for multimodal classification
Classification using multimodal data arises in many machine learning applications. It is crucial not only to model cross-modal relationship effectively but also to ensure robustness against loss of part of data or modali…
ClassificationDeep LearningGeneral ClassificationStructure Optimization for Deep Multimodal Fusion Networks using Graph-Induced Kernels
A popular testbed for deep learning has been multimodal recognition of human activity or gesture involving diverse inputs such as video, audio, skeletal pose and depth images. Deep learning architectures have excelled on…
Activity RecognitionBayesian OptimizationDeep LearningHuman Activity RecognitionRobust Multimodal Fusion for Human Activity Recognition
The proliferation of IoT and mobile devices equipped with heterogeneous sensors has enabled new applications that rely on the fusion of time-series data generated by multiple sensors with different modalities. While ther…
Activity RecognitionDenoisingHuman Activity RecognitionTime Series+1MuMu: Cooperative Multitask Learning-based Guided Multimodal Fusion
Multimodal sensors (visual, non-visual, and wearable) can provide complementary information to develop robust perception systems for recognizing activities accurately. However, it is challenging to extract robust multimo…
Activity RecognitionHuman Activity RecognitionMultimodal Activity RecognitionEgocentric Activity Recognition with Multimodal Fisher Vector
With the increasing availability of wearable devices, research on egocentric activity recognition has received much attention recently. In this paper, we build a Multimodal Egocentric Activity dataset which includes egoc…
Activity RecognitionEgocentric Activity Recognition