Fine-Grained Emotion Prediction by Modeling Emotion Definitions
In this paper, we propose a new framework for fine-grained emotion prediction in the text through emotion definition modeling. Our approach involves a multi-task learning framework that models definitions of emotions as an auxiliary task while being trained on the primary task of emotion prediction. We model definitions using masked language modeling and class definition prediction tasks. Our models outperform existing state-of-the-art for fine-grained emotion dataset GoEmotions. We further show that this trained model can be used for transfer learning on other benchmark datasets in emotion prediction with varying emotion label sets, domains, and sizes. The proposed models outperform the baselines on transfer learning experiments demonstrating the generalization capability of the models.
Code (1)
Tasks
Language ModelingLanguage ModellingMasked Language ModelingMulti-Task LearningPredictionTransfer LearningSimilar Papers 제목 키워드 기반
Hashtags, Emotions, and Comments: A Large-Scale Dataset to Understand Fine-Grained Social Emotions to Online Topics
This paper studies social emotions to online discussion topics. While most prior work focus on emotions from writers, we investigate readers{'} responses and explore the public feelings to an online topic. A large-scale …
An Emotional Journey: Detecting Emotion Trajectories in Dutch Customer Service Dialogues
The ability to track fine-grained emotions in customer service dialogues has many real-world applications, but has not been studied extensively. This paper measures the potential of prediction models on that task, based …
Beyond Global Emotion: Fine-Grained Emotional Speech Synthesis with Dynamic Word-Level Modulation
Emotional text-to-speech (E-TTS) is central to creating natural and trustworthy human-computer interaction. Existing systems typically rely on sentence-level control through predefined labels, reference audio, or natural…
Speech SynthesisEmoTrans: A Benchmark for Understanding, Reasoning, and Predicting Emotion Transitions in Multimodal LLMs
Recent multimodal large language models (MLLMs) have shown strong capabilities in perception, reasoning, and generation, and are increasingly used in applications such as social robots and human-computer interaction, whe…
Change DetectionEmoSpeaker: One-shot Fine-grained Emotion-Controlled Talking Face Generation
Implementing fine-grained emotion control is crucial for emotion generation tasks because it enhances the expressive capability of the generative model, allowing it to accurately and comprehensively capture and express v…
AttributeFace GenerationTalking Face Generation