Exploring Contrastive Learning for Multimodal Detection of Misogynistic Memes
Misogynistic memes are rampant on social media, and often convey their messages using multimodal signals (e.g., images paired with derogatory text or captions). However, to date very few multimodal systems have been leveraged for the detection of misogynistic memes. Recently, researchers have turned to contrastive learning, and most notably OpenAI’s CLIP model, is an innovative solution to a variety of multimodal tasks. In this work, we experiment with contrastive learning to address the detection of misogynistic memes within the context of SemEval 2022 Task 5. Although our model does not achieve top results, these experiments provide important exploratory findings for this task. We conduct a detailed error analysis, revealing promising clues and offering a foundation for follow-up work.
Code (2)
Tasks
Contrastive LearningSimilar Papers 제목 키워드 기반
Benchmark dataset of memes with text transcriptions for automatic detection of multi-modal misogynistic content
In this paper we present a benchmark dataset generated as part of a project for automatic identification of misogyny within online content, which focuses in particular on memes. The benchmark here described is composed o…
TeamOtter at SemEval-2022 Task 5: Detecting Misogynistic Content in Multimodal Memes
We describe our system for the SemEval 2022 task on detecting misogynous content in memes. This is a pressing problem and we explore various methods ranging from traditional machine learning to deep learning models such …
World KnowledgeWhat is Beneath Misogyny: Misogynous Memes Classification and Explanation
Memes are popular in the modern world and are distributed primarily for entertainment. However, harmful ideologies such as misogyny can be propagated through innocent-looking memes. The detection and understanding of why…
Misogynistic Meme Detection using Early Fusion Model with Graph Network
In recent years , there has been an upsurge in a new form of entertainment medium called memes. These memes although seemingly innocuous have transcended onto the boundary of online harassment against women and created a…
Poirot at SemEval-2022 Task 5: Leveraging Graph Network for Misogynistic Meme Detection
In recent years, there has been an upsurge in a new form of entertainment medium called memes. These memes although seemingly innocuous have transcended the boundary of online harassment against women and created an unwa…