paper-with-me

Papers

Self-supervised Learning for ECG-based Emotion Recognition

2019-10-14 · Pritam Sarkar, Ali Etemad

We present an electrocardiogram (ECG) -based emotion recognition system using self-supervised learning. Our proposed architecture consists of two main networks, a signal transformation recognition network and an emotion recognition network. First, unlabelled data are used to successfully train the former network to detect specific pre-determined signal transformations in the self-supervised learning step. Next, the weights of the convolutional layers of this network are transferred to the emotion recognition network, and two dense layers are trained in order to classify arousal and valence scores. We show that our self-supervised approach helps the model learn the ECG feature manifold required for emotion recognition, performing equal or better than the fully-supervised version of the model. Our proposed method outperforms the state-of-the-art in ECG-based emotion recognition with two publicly available datasets, SWELL and AMIGOS. Further analysis highlights the advantage of our self-supervised approach in requiring significantly less data to achieve acceptable results.

📄 PDF Abstract BibTeX arXiv:1910.07497

Code (2)

https://code.engineering.queensu.ca/pritam/SSL-ECG 공식 구현
pritamqu/SSL-ECG 공식 구현 tf

Tasks

Emotion RecognitionSelf-Supervised Learning

Similar Papers 제목 키워드 기반

Self-supervised ECG Representation Learning for Emotion Recognition

2020-02-04 · Pritam Sarkar, Ali Etemad

We exploit a self-supervised deep multi-task learning framework for electrocardiogram (ECG) -based emotion recognition. The proposed solution consists of two stages of learning a) learning ECG representations and b) lear…

Emotion RecognitionMulti-Task LearningRepresentation Learning

Self-Supervised learning with cross-modal transformers for emotion recognition

2020-11-20 · Aparna Khare, Srinivas Parthasarathy, Shiva Sundaram

Emotion recognition is a challenging task due to limited availability of in-the-wild labeled datasets. Self-supervised learning has shown improvements on tasks with limited labeled datasets in domains like speech and nat…

Emotion RecognitionLanguage ModelingLanguage ModellingMasked Language Modeling+3

GMSS: Graph-Based Multi-Task Self-Supervised Learning for EEG Emotion Recognition

2022-04-12 · Yang Li, Ji Chen, Fu Li, Boxun Fu 외

Previous electroencephalogram (EEG) emotion recognition relies on single-task learning, which may lead to overfitting and learned emotion features lacking generalization. In this paper, a graph-based multi-task self-supe…

Contrastive LearningEEGEEG Emotion RecognitionElectroencephalogram (EEG)+2

SS-VAERR: Self-Supervised Apparent Emotional Reaction Recognition from Video

2022-10-20 · Marija Jegorova, Stavros Petridis, Maja Pantic

This work focuses on the apparent emotional reaction recognition (AERR) from the video-only input, conducted in a self-supervised fashion. The network is first pre-trained on different self-supervised pretext tasks and l…

Self-Supervised Learning

emotion2vec: Self-Supervised Pre-Training for Speech Emotion Representation

2023-12-23 · Ziyang Ma, Zhisheng Zheng, Jiaxin Ye, Jinchao Li 외

We propose emotion2vec, a universal speech emotion representation model. emotion2vec is pre-trained on open-source unlabeled emotion data through self-supervised online distillation, combining utterance-level loss and fr…

Emotion RecognitionSelf-Supervised LearningSentiment AnalysisSpeech Emotion Recognition