Aspect-Based Emotion Analysis and Multimodal Coreference: A Case Study of Customer Comments on Adidas Instagram Posts
While aspect-based sentiment analysis of user-generated content has received a lot of attention in the past years, emotion detection at the aspect level has been relatively unexplored. Moreover, given the rise of more visual content on social media platforms, we want to meet the ever-growing share of multimodal content. In this paper, we present a multimodal dataset for Aspect-Based Emotion Analysis (ABEA). Additionally, we take the first steps in investigating the utility of multimodal coreference resolution in an ABEA framework. The presented dataset consists of 4,900 comments on 175 images and is annotated with aspect and emotion categories and the emotional dimensions of valence and arousal. Our preliminary experiments suggest that ABEA does not benefit from multimodal coreference resolution, and that aspect and emotion classification only requires textual information. However, when more specific information about the aspects is desired, image recognition could be essential.
Code (0)
등록된 구현이 없습니다.
Tasks
Aspect-Based Sentiment AnalysisAspect-Based Sentiment Analysis (ABSA)coreference-resolutionCoreference ResolutionEmotion ClassificationEmotion RecognitionSentiment AnalysisSimilar Papers 제목 키워드 기반
It’s absolutely divine! Can fine-grained sentiment analysis benefit from coreference resolution?
While it has been claimed that anaphora or coreference resolution plays an important role in opinion mining, it is not clear to what extent coreference resolution actually boosts performance, if at all. In this paper, we…
Aspect-Based Sentiment AnalysisAspect-Based Sentiment Analysis (ABSA)coreference-resolutionCoreference Resolution+2Scoring Coreference Chains with Split-Antecedent Anaphors
Anaphoric reference is an aspect of language interpretation covering a variety of types of interpretation beyond the simple case of identity reference to entities introduced via nominal expressions covered by the traditi…
UniSA: Unified Generative Framework for Sentiment Analysis
Sentiment analysis is a crucial task that aims to understand people's emotional states and predict emotional categories based on multimodal information. It consists of several subtasks, such as emotion recognition in con…
Aspect-Based Sentiment AnalysisAspect-Based Sentiment Analysis (ABSA)Emotion RecognitionEmotion Recognition in Conversation+2Affective Video Content Analysis: Decade Review and New Perspectives
Video content is rich in semantics and has the ability to evoke various emotions in viewers. In recent years, with the rapid development of affective computing and the explosive growth of visual data, affective video con…
Emotional IntelligenceEmotion RecognitionFacial Expression RecognitionVideo Emotion RecognitionR1-Omni: Explainable Omni-Multimodal Emotion Recognition with Reinforcement Learning
In this work, we present the first application of Reinforcement Learning with Verifiable Reward (RLVR) to an Omni-multimodal large language model in the context of emotion recognition, a task where both visual and audio …
Emotion RecognitionLanguage ModelingLanguage ModellingLarge Language Model+4