paper-with-me

홈 › Papers

Exploring Large Language Models for Multimodal Sentiment Analysis: Challenges, Benchmarks, and Future Directions

2024-11-23 · Shezheng Song

Multimodal Aspect-Based Sentiment Analysis (MABSA) aims to extract aspect terms and their corresponding sentiment polarities from multimodal information, including text and images. While traditional supervised learning methods have shown effectiveness in this task, the adaptability of large language models (LLMs) to MABSA remains uncertain. Recent advances in LLMs, such as Llama2, LLaVA, and ChatGPT, demonstrate strong capabilities in general tasks, yet their performance in complex and fine-grained scenarios like MABSA is underexplored. In this study, we conduct a comprehensive investigation into the suitability of LLMs for MABSA. To this end, we construct a benchmark to evaluate the performance of LLMs on MABSA tasks and compare them with state-of-the-art supervised learning methods. Our experiments reveal that, while LLMs demonstrate potential in multimodal understanding, they face significant challenges in achieving satisfactory results for MABSA, particularly in terms of accuracy and inference time. Based on these findings, we discuss the limitations of current LLMs and outline directions for future research to enhance their capabilities in multimodal sentiment analysis.

📄 PDF Abstract BibTeX arXiv:2411.15408

Code (0)

등록된 구현이 없습니다.

Tasks

Aspect-Based Sentiment AnalysisExtract AspectMultimodal Sentiment AnalysisSentiment Analysis

Similar Papers 제목 키워드 기반

Trustworthy Multimodal Fusion for Sentiment Analysis in Ordinal Sentiment Space

2024-04-13 · Zhuyang Xie, Yan Yang, Jie Wang, Xiaorong Liu 외

Multimodal video sentiment analysis aims to integrate multiple modal information to analyze the opinions and attitudes of speakers. Most previous work focuses on exploring the semantic interactions of intra- and inter-mo…

Multimodal Sentiment AnalysisSentiment Analysis

Unlocking Cross-Lingual Sentiment Analysis through Emoji Interpretation: A Multimodal Generative AI Approach

2024-12-23 · Rafid Ishrak Jahan, Heng Fan, Haihua Chen, Yunhe Feng

Emojis have become ubiquitous in online communication, serving as a universal medium to convey emotions and decorative elements. Their widespread use transcends language and cultural barriers, enhancing understanding and…

Sentiment Analysis

EmoVerse: Exploring Multimodal Large Language Models for Sentiment and Emotion Understanding

2024-12-11 · Ao Li, Longwei Xu, Chen Ling, Jinghui Zhang 외

Sentiment and emotion understanding are essential to applications such as human-computer interaction and depression detection. While Multimodal Large Language Models (MLLMs) demonstrate robust general capabilities, they …

Depression DetectionEmotion-Cause Pair ExtractionEmotion RecognitionFacial Expression Recognition+3

Large Language Models Meet Text-Centric Multimodal Sentiment Analysis: A Survey

2024-06-12 · Hao Yang, Yanyan Zhao, Yang Wu, Shilong Wang 외

Compared to traditional sentiment analysis, which only considers text, multimodal sentiment analysis needs to consider emotional signals from multimodal sources simultaneously and is therefore more consistent with the wa…

Multimodal Sentiment AnalysisSentiment Analysis

Enhanced Multimodal Aspect-Based Sentiment Analysis by LLM-Generated Rationales

2025-05-20 · Jun Cao, Jiyi Li, Ziwei Yang, Renjie Zhou

There has been growing interest in Multimodal Aspect-Based Sentiment Analysis (MABSA) in recent years. Existing methods predominantly rely on pre-trained small language models (SLMs) to collect information related to asp…

Aspect-Based Sentiment AnalysisSentiment Analysis