Benchmarking Multimodal Sentiment Analysis
We propose a framework for multimodal sentiment analysis and emotion recognition using convolutional neural network-based feature extraction from text and visual modalities. We obtain a performance improvement of 10% over the state of the art by combining visual, text and audio features. We also discuss some major issues frequently ignored in multimodal sentiment analysis research: the role of speaker-independent models, importance of the modalities and generalizability. The paper thus serve as a new benchmark for further research in multimodal sentiment analysis and also demonstrates the different facets of analysis to be considered while performing such tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
BenchmarkingEmotion RecognitionMultimodal Sentiment AnalysisSentiment AnalysisSimilar Papers 제목 키워드 기반
Large Language Models Meet Text-Centric Multimodal Sentiment Analysis: A Survey
Compared to traditional sentiment analysis, which only considers text, multimodal sentiment analysis needs to consider emotional signals from multimodal sources simultaneously and is therefore more consistent with the wa…
Multimodal Sentiment AnalysisSentiment AnalysisMultimodal Deep Reinforcement Learning for Portfolio Optimization
We propose a reinforcement learning (RL) framework that leverages multimodal data including historical stock prices, sentiment analysis, and topic embeddings from news articles, to optimize trading strategies for SP100 s…
ArticlesBenchmarkingDeep Reinforcement LearningPortfolio Optimization+4Leveraging Textual-Cues for Enhancing Multimodal Sentiment Analysis by Object Recognition
Multimodal sentiment analysis, which includes both image and text data, presents several challenges due to the dissimilarities in the modalities of text and image, the ambiguity of sentiment, and the complexities of cont…
Multimodal Sentiment AnalysisObject RecognitionA Multimodal Sentiment Dataset for Video Recommendation
Recently, multimodal sentiment analysis has seen remarkable advance and a lot of datasets are proposed for its development. In general, current multimodal sentiment analysis datasets usually follow the traditional system…
Multimodal Sentiment AnalysisSentiment AnalysisVideo UnderstandingTrustworthy Multimodal Fusion for Sentiment Analysis in Ordinal Sentiment Space
Multimodal video sentiment analysis aims to integrate multiple modal information to analyze the opinions and attitudes of speakers. Most previous work focuses on exploring the semantic interactions of intra- and inter-mo…
Multimodal Sentiment AnalysisSentiment Analysis