paper-with-me

홈 › Papers

Deciphering Hate: Identifying Hateful Memes and Their Targets

2024-03-16 · Eftekhar Hossain, Omar Sharif, Mohammed Moshiul Hoque, Sarah M. Preum

Internet memes have become a powerful means for individuals to express emotions, thoughts, and perspectives on social media. While often considered as a source of humor and entertainment, memes can also disseminate hateful content targeting individuals or communities. Most existing research focuses on the negative aspects of memes in high-resource languages, overlooking the distinctive challenges associated with low-resource languages like Bengali (also known as Bangla). Furthermore, while previous work on Bengali memes has focused on detecting hateful memes, there has been no work on detecting their targeted entities. To bridge this gap and facilitate research in this arena, we introduce a novel multimodal dataset for Bengali, BHM (Bengali Hateful Memes). The dataset consists of 7,148 memes with Bengali as well as code-mixed captions, tailored for two tasks: (i) detecting hateful memes, and (ii) detecting the social entities they target (i.e., Individual, Organization, Community, and Society). To solve these tasks, we propose DORA (Dual cO attention fRAmework), a multimodal deep neural network that systematically extracts the significant modality features from the memes and jointly evaluates them with the modality-specific features to understand the context better. Our experiments show that DORA is generalizable on other low-resource hateful meme datasets and outperforms several state-of-the-art rivaling baselines.

📄 PDF Abstract BibTeX arXiv:2403.10829

Code (3)

eftekhar-hossain/bengali-hateful-memes 공식 구현 tf
eftekhar-hossain/MUTE-AACL22
eftekhar-hossain/Multimodal-Hateful-Memes

Similar Papers 제목 키워드 기반

Improving Hateful Meme Detection through Retrieval-Guided Contrastive Learning

2023-11-14 · Jingbiao Mei, Jinghong Chen, Weizhe Lin, Bill Byrne 외

Hateful memes have emerged as a significant concern on the Internet. Detecting hateful memes requires the system to jointly understand the visual and textual modalities. Our investigation reveals that the embedding space…

Contrastive LearningHateful Meme ClassificationMeme ClassificationRetrieval

HateSieve: A Contrastive Learning Framework for Detecting and Segmenting Hateful Content in Multimodal Memes

2024-08-11 · Xuanyu Su, Yansong Li, Diana Inkpen, Nathalie Japkowicz

Amidst the rise of Large Multimodal Models (LMMs) and their widespread application in generating and interpreting complex content, the risk of propagating biased and harmful memes remains significant. Current safety meas…

Contrastive LearningTriplet

Racist or Sexist Meme? Classifying Memes beyond Hateful

2021-08-01 · ACL (WOAH) 2021 8 · Haris Bin Zia, Ignacio Castro, Gareth Tyson

Memes are the combinations of text and images that are often humorous in nature. But, that may not always be the case, and certain combinations of texts and images may depict hate, referred to as hateful memes. This work…

Memes in the Wild: Assessing the Generalizability of the Hateful Memes Challenge Dataset

2021-07-09 · ACL (WOAH) 2021 8 · Hannah Rose Kirk, Yennie Jun, Paulius Rauba, Gal Wachtel 외

Hateful memes pose a unique challenge for current machine learning systems because their message is derived from both text- and visual-modalities. To this effect, Facebook released the Hateful Memes Challenge, a dataset …

Optical Character Recognition (OCR)

Multimodal Learning for Hateful Memes Detection

2020-11-25 · Yi Zhou, Zhenhao Chen

Memes are used for spreading ideas through social networks. Although most memes are created for humor, some memes become hateful under the combination of pictures and text. Automatically detecting the hateful memes can h…

Image CaptioningMultimodal Deep Learning