Multimodal deep learning approach for joint EEG-EMG data compression and classification
In this paper, we present a joint compression and classification approach of EEG and EMG signals using a deep learning approach. Specifically, we build our system based on the deep autoencoder architecture which is designed not only to extract discriminant features in the multimodal data representation but also to reconstruct the data from the latent representation using encoder-decoder layers. Since autoencoder can be seen as a compression approach, we extend it to handle multimodal data at the encoder layer, reconstructed and retrieved at the decoder layer. We show through experimental results, that exploiting both multimodal data intercorellation and intracorellation 1) Significantly reduces signal distortion particularly for high compression levels 2) Achieves better accuracy in classifying EEG and EMG signals recorded and labeled according to the sentiments of the volunteer.
Code (0)
등록된 구현이 없습니다.
Tasks
Data CompressionDecoderEEGElectroencephalogram (EEG)General ClassificationMultimodal Deep LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Learned Multimodal Compression for Autonomous Driving
Autonomous driving sensors generate an enormous amount of data. In this paper, we explore learned multimodal compression for autonomous driving, specifically targeted at 3D object detection. We focus on camera and LiDAR …
3D Object DetectionAutonomous Drivingobject-detectionObject DetectionOmniZip: Audio-Guided Dynamic Token Compression for Fast Omnimodal Large Language Models
Omnimodal large language models (OmniLLMs) have attracted increasing research attention of late towards unified audio-video understanding. However, the high computational cost of processing longer joint audio-video token…
Optimized Learned Image Compression for Facial Expression Recognition
Efficient data compression is crucial for the storage and transmission of visual data. However, in facial expression recognition (FER) tasks, lossy compression often leads to feature degradation and reduced accuracy. To …
Facial Expression RecognitionImage CompressionVideo Compression With Rate-Distortion Autoencoders
In this paper we present a a deep generative model for lossy video compression. We employ a model that consists of a 3D autoencoder with a discrete latent space and an autoregressive prior used for entropy coding. Both a…
Motion CompensationSemantic CompressionVideo CompressionResource-Limited Joint Multimodal Sentiment Reasoning and Classification via Chain-of-Thought Enhancement and Distillation
The surge in rich multimodal content on social media platforms has greatly advanced Multimodal Sentiment Analysis (MSA), with Large Language Models (LLMs) further accelerating progress in this field. Current approaches p…
Multimodal Sentiment AnalysisMulti-Task Learning