Improving Generalization for Multimodal Fake News Detection
The increasing proliferation of misinformation and its alarming impact have motivated both industry and academia to develop approaches for fake news detection. However, state-of-the-art approaches are usually trained on datasets of smaller size or with a limited set of specific topics. As a consequence, these models lack generalization capabilities and are not applicable to real-world data. In this paper, we propose three models that adopt and fine-tune state-of-the-art multimodal transformers for multimodal fake news detection. We conduct an in-depth analysis by manipulating the input data aimed to explore models performance in realistic use cases on social media. Our study across multiple models demonstrates that these systems suffer significant performance drops against manipulated data. To reduce the bias and improve model generalization, we suggest training data augmentation to conduct more meaningful experiments for fake news detection on social media. The proposed data augmentation techniques enable models to generalize better and yield improved state-of-the-art results.
Code (1)
Tasks
Data AugmentationFake News DetectionMisinformationSimilar Papers 제목 키워드 기반
Triple Path Enhanced Neural Architecture Search for Multimodal Fake News Detection
Multimodal fake news detection has become one of the most crucial issues on social media platforms. Although existing methods have achieved advanced performance, two main challenges persist: (1) Under-performed multimoda…
Fake News DetectionNeural Architecture SearchEach Fake News is Fake in its Own Way: An Attribution Multi-Granularity Benchmark for Multimodal Fake News Detection
Social platforms, while facilitating access to information, have also become saturated with a plethora of fake news, resulting in negative consequences. Automatic multimodal fake news detection is a worthwhile pursuit. E…
Fake News DetectionMMNet: Multimodal Fusion via Mutual Learning Network for Fake News Detection
The rapid development of social media provides a hotbed for the dissemination of fake news, which misleads readers and causes negative effects on society. We observe that a large amount of news contains images in additio…
Fake News DetectionSimilarity-Aware Multimodal Prompt Learning for Fake News Detection
The standard paradigm for fake news detection mainly utilizes text information to model the truthfulness of news. However, the discourse of online fake news is typically subtle and it requires expert knowledge to use tex…
Fake News DetectionLanguage ModellingPrompt LearningDeconfounded Reasoning for Multimodal Fake News Detection via Causal Intervention
The rapid growth of social media has led to the widespread dissemination of fake news across multiple content forms, including text, images, audio, and video. Traditional unimodal detection methods fall short in addressi…
DisentanglementFake News Detection