Context Unlocks Emotions: Text-based Emotion Classification Dataset Auditing with Large Language Models
The lack of contextual information in text data can make the annotation process of text-based emotion classification datasets challenging. As a result, such datasets often contain labels that fail to consider all the relevant emotions in the vocabulary. This misalignment between text inputs and labels can degrade the performance of machine learning models trained on top of them. As re-annotating entire datasets is a costly and time-consuming task that cannot be done at scale, we propose to use the expressive capabilities of large language models to synthesize additional context for input text to increase its alignment with the annotated emotional labels. In this work, we propose a formal definition of textual context to motivate a prompting strategy to enhance such contextual information. We provide both human and empirical evaluation to demonstrate the efficacy of the enhanced context. Our method improves alignment between inputs and their human-annotated labels from both an empirical and human-evaluated standpoint.
Code (0)
등록된 구현이 없습니다.
Tasks
Emotion ClassificationSimilar Papers 제목 키워드 기반
Moodifier: MLLM-Enhanced Emotion-Driven Image Editing
Bridging emotions and visual content for emotion-driven image editing holds great potential in creative industries, yet precise manipulation remains challenging due to the abstract nature of emotions and their varied man…
Image EditingEmotion Classification by Jointly Learning to Lexiconize and Classify
Emotion lexicons have been shown effective for emotion classification (Baziotis et al., 2018). Previous studies handle emotion lexicon construction and emotion classification separately. In this paper, we propose an emot…
ClassificationEmotion ClassificationSentenceMM-EMOG: Multi-Label Emotion Graph Representation for Mental Health Classification on Social Media
More than 80% of people who commit suicide disclose their intention to do so on social media. The main information we can use in social media is user-generated posts, since personal information is not always available. I…
ClassificationSocial Media Mental Health DetectionSINAI at SemEval-2019 Task 3: Using affective features for emotion classification in textual conversations
Detecting emotions in textual conversation is a challenging problem in absence of nonverbal cues typically associated with emotion, like fa- cial expression or voice modulations. How- ever, more and more users are using …
Emotion ClassificationGeneral ClassificationReal-Time Emotion Classification Using EEG Data Stream in E-Learning Contexts
In face-to-face and online learning, emotions and emotional intelligence have an influence and play an essential role. Learners’ emotions are crucial for e-learning system because they promote or restrain the learning. M…
ClassificationEEGElectroencephalogram (EEG)Emotional Intelligence+1