Exploring Multimodal Sentiment Analysis via CBAM Attention and Double-layer BiLSTM Architecture
Because multimodal data contains more modal information, multimodal sentiment analysis has become a recent research hotspot. However, redundant information is easily involved in feature fusion after feature extraction, which has a certain impact on the feature representation after fusion. Therefore, in this papaer, we propose a new multimodal sentiment analysis model. In our model, we use BERT + BiLSTM as new feature extractor to capture the long-distance dependencies in sentences and consider the position information of input sequences to obtain richer text features. To remove redundant information and make the network pay more attention to the correlation between image and text features, CNN and CBAM attention are added after splicing text features and picture features, to improve the feature representation ability. On the MVSA-single dataset and HFM dataset, compared with the baseline model, the ACC of our model is improved by 1.78% and 1.91%, and the F1 value is enhanced by 3.09% and 2.0%, respectively. The experimental results show that our model achieves a sound effect, similar to the advanced model.
Code (0)
등록된 구현이 없습니다.
Tasks
Multimodal Sentiment AnalysisSentiment AnalysisMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Dynamic Multimodal Sentiment Analysis: Leveraging Cross-Modal Attention for Enabled Classification
This paper explores the development of a multimodal sentiment analysis model that integrates text, audio, and visual data to enhance sentiment classification. The goal is to improve emotion detection by capturing the com…
Multimodal Sentiment AnalysisSentiment AnalysisSentiment ClassificationCross-Modal BERT for Text-Audio Sentiment Analysis
Multimodal sentiment analysis is an emerging research field that aims to enable machines to recognize, interpret, and express emotion. Through the cross-modal interaction, we can get more comprehensive emotional characte…
Multimodal Sentiment AnalysisNatural Language InferenceQuestion AnsweringSentiment AnalysisTrustworthy Multimodal Fusion for Sentiment Analysis in Ordinal Sentiment Space
Multimodal video sentiment analysis aims to integrate multiple modal information to analyze the opinions and attitudes of speakers. Most previous work focuses on exploring the semantic interactions of intra- and inter-mo…
Multimodal Sentiment AnalysisSentiment AnalysisMultimodal Sentiment Analysis with Word-Level Fusion and Reinforcement Learning
With the increasing popularity of video sharing websites such as YouTube and Facebook, multimodal sentiment analysis has received increasing attention from the scientific community. Contrary to previous works in multimod…
Multimodal Sentiment Analysisreinforcement-learningReinforcement LearningReinforcement Learning (RL)+3Transfer Learning with Joint Fine-Tuning for Multimodal Sentiment Analysis
Most existing methods focus on sentiment analysis of textual data. However, recently there has been a massive use of images and videos on social platforms, motivating sentiment analysis from other modalities. Current stu…
Multimodal Sentiment AnalysisSentiment AnalysisSentiment ClassificationTransfer Learning