paper-with-me

Papers

Generative Technology for Human Emotion Recognition: A Scope Review

2024-07-04 · Fei Ma, Yucheng Yuan, Yifan Xie, Hongwei Ren, Ivan Liu, Ying He, Fuji Ren, Fei Richard Yu, Shiguang Ni

Affective computing stands at the forefront of artificial intelligence (AI), seeking to imbue machines with the ability to comprehend and respond to human emotions. Central to this field is emotion recognition, which endeavors to identify and interpret human emotional states from different modalities, such as speech, facial images, text, and physiological signals. In recent years, important progress has been made in generative models, including Autoencoder, Generative Adversarial Network, Diffusion Model, and Large Language Model. These models, with their powerful data generation capabilities, emerge as pivotal tools in advancing emotion recognition. However, up to now, there remains a paucity of systematic efforts that review generative technology for emotion recognition. This survey aims to bridge the gaps in the existing literature by conducting a comprehensive analysis of over 320 research papers until June 2024. Specifically, this survey will firstly introduce the mathematical principles of different generative models and the commonly used datasets. Subsequently, through a taxonomy, it will provide an in-depth analysis of how generative techniques address emotion recognition based on different modalities in several aspects, including data augmentation, feature extraction, semi-supervised learning, cross-domain, etc. Finally, the review will outline future research directions, emphasizing the potential of generative models to advance the field of emotion recognition and enhance the emotional intelligence of AI systems.

📄 PDF Abstract BibTeX arXiv:2407.03640

Code (0)

등록된 구현이 없습니다.

Tasks

Data AugmentationEmotional IntelligenceEmotion RecognitionGenerative Adversarial NetworkLanguage ModellingLarge Language ModelSurvey

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Generative Learning as a Tool to Improve Perception of Emotional Body Motion Expressions

2026-06-27 · Huakun Liu, Miao Cheng, Xin Wei, Felix Dollack 외 arxiv

Emotional body motion expressions are an essential element of non-verbal communication. Effectively conveying these expressions through technology is of utmost importance, for example, with virtual reality avatars and in…

Emotion Recognition

A Review of Human Emotion Synthesis Based on Generative Technology

2024-12-10 · Fei Ma, Yukan Li, Yifan Xie, Ying He 외

Human emotion synthesis is a crucial aspect of affective computing. It involves using computational methods to mimic and convey human emotions through various modalities, with the goal of enabling more natural and effect…

Emotion Recognition in Audio and Video Using Deep Neural Networks

2020-06-15 · Mandeep Singh, Yuan Fang

Humans are able to comprehend information from multiple domains for e.g. speech, text and visual. With advancement of deep learning technology there has been significant improvement of speech recognition. Recognizing emo…

Deep LearningEmotion RecognitionMultimodal Emotion Recognitionspeech-recognition+2

FunAudioLLM: Voice Understanding and Generation Foundation Models for Natural Interaction Between Humans and LLMs

2024-07-04 · Keyu An, Qian Chen, Chong Deng, Zhihao Du 외

This report introduces FunAudioLLM, a model family designed to enhance natural voice interactions between humans and large language models (LLMs). At its core are two innovative models: SenseVoice, which handles multilin…

Emotion RecognitionEvent DetectionIn-Context LearningInstruction Following+4

Large Language Model Based Generative Error Correction: A Challenge and Baselines for Speech Recognition, Speaker Tagging, and Emotion Recognition

2024-09-15 · Chao-Han Huck Yang, Taejin Park, Yuan Gong, Yuanchao Li 외

Given recent advances in generative AI technology, a key question is how large language models (LLMs) can enhance acoustic modeling tasks using text decoding results from a frozen, pretrained automatic speech recognition…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Emotion RecognitionLanguage Modeling+4