Transformer based neural networks for emotion recognition in conversations
This paper outlines the approach of the ISDS-NLP team in the SemEval 2024 Task 10: Emotion Discovery and Reasoning its Flip in Conversation (EDiReF). For Subtask 1 we obtained a weighted F1 score of 0.43 and placed 12 in the leaderboard. We investigate two distinct approaches: Masked Language Modeling (MLM) and Causal Language Modeling (CLM). For MLM, we employ pre-trained BERT-like models in a multilingual setting, fine-tuning them with a classifier to predict emotions. Experiments with varying input lengths, classifier architectures, and fine-tuning strategies demonstrate the effectiveness of this approach. Additionally, we utilize Mistral 7B Instruct V0.2, a state-of-the-art model, applying zero-shot and few-shot prompting techniques. Our findings indicate that while Mistral shows promise, MLMs currently outperform them in sentence-level emotion classification.
Code (1)
Tasks
Causal Language ModelingEmotion ClassificationEmotion RecognitionLanguage ModelingLanguage ModellingMasked Language ModelingSentenceMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Beyond Isolated Utterances: Conversational Emotion Recognition
Speech emotion recognition is the task of recognizing the speaker's emotional state given a recording of their utterance. While most of the current approaches focus on inferring emotion from isolated utterances, we argue…
Emotion RecognitionSpeech Emotion RecognitionKnowledge Aware Emotion Recognition in Textual Conversations via Multi-Task Incremental Transformer
Emotion recognition in textual conversations (ERTC) plays an important role in a wide range of applications, such as opinion mining, recommender systems, and so on. ERTC, however, is a challenging task. For one thing, sp…
Emotion RecognitionGraph AttentionMulti-Task LearningOpinion Mining+1IITK at SemEval-2024 Task 10: Who is the speaker? Improving Emotion Recognition and Flip Reasoning in Conversations via Speaker Embeddings
This paper presents our approach for the SemEval-2024 Task 10: Emotion Discovery and Reasoning its Flip in Conversations. For the Emotion Recognition in Conversations (ERC) task, we utilize a masked-memory network along …
Emotion RecognitionA Transformer-Based Model With Self-Distillation for Multimodal Emotion Recognition in Conversations
Emotion recognition in conversations (ERC), the task of recognizing the emotion of each utterance in a conversation, is crucial for building empathetic machines. Existing studies focus mainly on capturing context- and sp…
Emotion RecognitionEmotion Recognition in ConversationMultimodal Emotion RecognitionDiscovering Emotion and Reasoning its Flip in Multi-Party Conversations using Masked Memory Network and Transformer
Efficient discovery of a speaker's emotional states in a multi-party conversation is significant to design human-like conversational agents. During a conversation, the cognitive state of a speaker often alters due to cer…
Emotion Recognition