Unimodal Intermediate Training for Multimodal Meme Sentiment Classification
Internet Memes remain a challenging form of user-generated content for automated sentiment classification. The availability of labelled memes is a barrier to developing sentiment classifiers of multimodal memes. To address the shortage of labelled memes, we propose to supplement the training of a multimodal meme classifier with unimodal (image-only and text-only) data. In this work, we present a novel variant of supervised intermediate training that uses relatively abundant sentiment-labelled unimodal data. Our results show a statistically significant performance improvement from the incorporation of unimodal text data. Furthermore, we show that the training set of labelled memes can be reduced by 40% without reducing the performance of the downstream model.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationSentiment AnalysisSentiment ClassificationSimilar Papers 제목 키워드 기반
MemeSem:A Multi-modal Framework for Sentimental Analysis of Meme via Transfer Learning
In the age of the internet, Memes have grown to be one of the hottest subjects on the internet and arguably. But despite their huge growth, there is not much attention towards meme sentimental analysis. In this paper, we…
Language ModelingLanguage ModellingSentiment AnalysisTransfer LearningMemoSen: A Multimodal Dataset for Sentiment Analysis of Memes
Posting and sharing memes have become a powerful expedient of expressing opinions on social media in recent days. Analysis of sentiment from memes has gained much attention to researchers due to its substantial implicati…
Multimodal Sentiment AnalysisSentiment AnalysisSentiment ClassificationDNN Multimodal Fusion Techniques for Predicting Video Sentiment
We present our work on sentiment prediction using the benchmark MOSI dataset from the CMU-MultimodalDataSDK. Previous work on multimodal sentiment analysis have been focused on input-level feature fusion or decision-leve…
feature selectionMultimodal Sentiment AnalysisSentiment AnalysisExplainable Multimodal Sentiment Analysis on Bengali Memes
Memes have become a distinctive and effective form of communication in the digital era, attracting online communities and cutting across cultural barriers. Even though memes are frequently linked with humor, they have an…
Explainable artificial intelligenceExplainable Artificial Intelligence (XAI)Multimodal Sentiment AnalysisSentiment AnalysisIITK at SemEval-2020 Task 8: Unimodal and Bimodal Sentiment Analysis of Internet Memes
Social media is abundant in visual and textual information presented together or in isolation. Memes are the most popular form, belonging to the former class. In this paper, we present our approaches for the Memotion Ana…
Sentiment AnalysisSentiment Classification