paper-with-me

Papers

Disentangled Variational Autoencoder for Emotion Recognition in Conversations

2023-05-23 · Kailai Yang, Tianlin Zhang, Sophia Ananiadou

In Emotion Recognition in Conversations (ERC), the emotions of target utterances are closely dependent on their context. Therefore, existing works train the model to generate the response of the target utterance, which aims to recognise emotions leveraging contextual information. However, adjacent response generation ignores long-range dependencies and provides limited affective information in many cases. In addition, most ERC models learn a unified distributed representation for each utterance, which lacks interpretability and robustness. To address these issues, we propose a VAD-disentangled Variational AutoEncoder (VAD-VAE), which first introduces a target utterance reconstruction task based on Variational Autoencoder, then disentangles three affect representations Valence-Arousal-Dominance (VAD) from the latent space. We also enhance the disentangled representations by introducing VAD supervision signals from a sentiment lexicon and minimising the mutual information between VAD distributions. Experiments show that VAD-VAE outperforms the state-of-the-art model on two datasets. Further analysis proves the effectiveness of each proposed module and the quality of disentangled VAD representations. The code is available at https://github.com/SteveKGYang/VAD-VAE.

📄 PDF Abstract BibTeX arXiv:2305.14071

Code (1)

stevekgyang/vad-vae 공식 구현 pytorch

Tasks

Emotion RecognitionResponse Generation

Similar Papers 제목 키워드 기반

Deep Imbalanced Learning for Multimodal Emotion Recognition in Conversations

2023-12-11 · Tao Meng, Yuntao Shou, Wei Ai, Nan Yin 외

The main task of Multimodal Emotion Recognition in Conversations (MERC) is to identify the emotions in modalities, e.g., text, audio, image and video, which is a significant development direction for realizing machine in…

Data AugmentationEmotion RecognitionGenerative Adversarial NetworkGraph Neural Network+2

SA-DVAE: Improving Zero-Shot Skeleton-Based Action Recognition by Disentangled Variational Autoencoders

2024-07-18 · Sheng-Wei Li, Zi-Xiang Wei, Wei-Jie Chen, Yi-Hsin Yu 외

Existing zero-shot skeleton-based action recognition methods utilize projection networks to learn a shared latent space of skeleton features and semantic embeddings. The inherent imbalance in action recognition datasets,…

Action RecognitionDisentanglementGeneralized Zero Shot skeletal action recognitionSkeleton Based Action Recognition+2

Variational Autoencoders for Learning Latent Representations of Speech Emotion: A Preliminary Study

2017-12-23 · Siddique Latif, Rajib Rana, Junaid Qadir, Julien Epps

Learning the latent representation of data in unsupervised fashion is a very interesting process that provides relevant features for enhancing the performance of a classifier. For speech emotion recognition tasks, genera…

Emotion ClassificationEmotion RecognitionGeneral ClassificationSpeech Emotion Recognition

A vector quantized masked autoencoder for speech emotion recognition

2023-04-21 · Samir Sadok, Simon Leglaive, Renaud Séguier

Recent years have seen remarkable progress in speech emotion recognition (SER), thanks to advances in deep learning techniques. However, the limited availability of labeled data remains a significant challenge in the fie…

Emotion RecognitionSelf-Supervised LearningSpeech Emotion Recognition

A vector quantized masked autoencoder for audiovisual speech emotion recognition

2023-05-05 · Samir Sadok, Simon Leglaive, Renaud Séguier

An important challenge in emotion recognition is to develop methods that can leverage unlabeled training data. In this paper, we propose the VQ-MAE-AV model, a self-supervised multimodal model that leverages masked autoe…

Contrastive LearningEmotion RecognitionRepresentation LearningSelf-Supervised Learning+1