Cluster-based Deep Ensemble Learning for Emotion Classification in Internet Memes
Memes have gained popularity as a means to share visual ideas through the Internet and social media by mixing text, images and videos, often for humorous purposes. Research enabling automated analysis of memes has gained attention in recent years, including among others the task of classifying the emotion expressed in memes. In this paper, we propose a novel model, cluster-based deep ensemble learning (CDEL), for emotion classification in memes. CDEL is a hybrid model that leverages the benefits of a deep learning model in combination with a clustering algorithm, which enhances the model with additional information after clustering memes with similar facial features. We evaluate the performance of CDEL on a benchmark dataset for emotion classification, proving its effectiveness by outperforming a wide range of baseline models and achieving state-of-the-art performance. Further evaluation through ablated models demonstrates the effectiveness of the different components of CDEL.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringEmotion ClassificationEnsemble LearningSimilar Papers 제목 키워드 기반
Towards Building an Open-Domain Dialogue System Incorporated with Internet Memes
In recent years, Internet memes have been widely used in online chatting. Compared with text-based communication, conversations become more expressive and attractive when Internet memes are incorporated. This paper prese…
Emotion ClassificationResponse GenerationRetrievalText MatchingSemEval-2020 Task 8: Memotion Analysis- the Visuo-Lingual Metaphor!
Information on social media comprises of various modalities such as textual, visual and audio. NLP and Computer Vision communities often leverage only one prominent modality in isolation to study social media. However, c…
Emotion RecognitionSemEval-2020 Task 8: Memotion Analysis -- The Visuo-Lingual Metaphor!
Information on social media comprises of various modalities such as textual, visual and audio. NLP and Computer Vision communities often leverage only one prominent modality in isolation to study social media. However, t…
Emotion RecognitionYNU-HPCC at SemEval-2020 Task 8: Using a Parallel-Channel Model for Memotion Analysis
In recent years, the growing ubiquity of Internet memes on social media platforms, such as Facebook, Instagram, and Twitter, has become a topic of immense interest. However, the classification and recognition of memes is…
Emotion RecognitionSentiment AnalysisSentiment ClassificationSuggestion miningNUAA-QMUL at SemEval-2020 Task 8: Utilizing BERT and DenseNet for Internet Meme Emotion Analysis
This paper describes our contribution to SemEval 2020 Task 8: Memotion Analysis. Our system learns multi-modal embeddings from text and images in order to classify Internet memes by sentiment. Our model learns text embed…
Emotion Recognitionimage-classificationImage Classification