Only text? only image? or both? Predicting sentiment of internet memes
Nowadays, the spread of Internet memes on online social media platforms such as Instagram, Facebook, Reddit, and Twitter is very fast. Analyzing the sentiment of memes can provide various useful insights. Meme sentiment classification is a new area of research that is not explored yet. Recently SemEval provides a dataset for meme sentiment classification. As this dataset is highly imbalanced, we extend this dataset by annotating new instances and use a sampling strategy to build a meme sentiment classifier. We propose a multi-modal framework for meme sentiment classification by utilizing textual and visual features of the meme. We found that for meme sentiment classification, only textual or only visual features are not sufficient. Our proposed framework utilizes textual as well as visual features together. We propose to use the attention mechanism to improve meme classification performance. Our proposed framework achieves macro F1 and accuracy of 34.23 and 50.02, respectively. It increases the accuracy by 6.77 and 7.86 compared to only textual and visual features, respectively.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationMeme ClassificationSentiment AnalysisSentiment ClassificationSimilar Papers 제목 키워드 기반
Deep Neural Networks In Fully Connected CRF For Image Labeling With Social Network Metadata
We propose a novel method for predicting image labels by fusing image content descriptors with the social media context of each image. An image uploaded to a social media site such as Flickr often has meaningful, associa…
MM-Rec: Multimodal News Recommendation
Accurate news representation is critical for news recommendation. Most of existing news representation methods learn news representations only from news texts while ignore the visual information in news like images. In f…
News Recommendationobject-detectionObject DetectionBodyMAP - Jointly Predicting Body Mesh and 3D Applied Pressure Map for People in Bed
Accurately predicting the 3D human posture and the pressure exerted on the body for people resting in bed visualized as a body mesh (3D pose & shape) with a 3D pressure map holds significant promise for healthcare ap…
BodyMAP -- Jointly Predicting Body Mesh and 3D Applied Pressure Map for People in Bed
Accurately predicting the 3D human posture and the pressure exerted on the body for people resting in bed, visualized as a body mesh (3D pose & shape) with a 3D pressure map, holds significant promise for healthcare appl…
Transformer-Based Classification Outcome Prediction for Multimodal Stroke Treatment
This study proposes a multi-modal fusion framework Multitrans based on the Transformer architecture and self-attention mechanism. This architecture combines the study of non-contrast computed tomography (NCCT) images and…
Diagnosticimage-classificationImage ClassificationPrediction+2