AIRD: Adversarial Learning Framework for Image Repurposing Detection
Image repurposing is a commonly used method for spreading misinformation on social media and online forums, which involves publishing untampered images with modified metadata to create rumors and further propaganda. While manual verification is possible, given vast amounts of verified knowledge available on the internet, the increasing prevalence and ease of this form of semantic manipulation call for the development of robust automatic ways of assessing the semantic integrity of multimedia data. In this paper, we present a novel method for image repurposing detection that is based on the real-world adversarial interplay between a bad actor who repurposes images with counterfeit metadata and a watchdog who verifies the semantic consistency between images and their accompanying metadata, where both players have access to a reference dataset of verified content, which they can use to achieve their goals. The proposed method exhibits state-of-the-art performance on location-identity, subject-identity and painting-artist verification, showing its efficacy across a diverse set of scenarios.
Code (1)
Tasks
MisinformationSimilar Papers 제목 키워드 기반
FairDeFace: Evaluating the Fairness and Adversarial Robustness of Face Obfuscation Methods
The lack of a common platform and benchmark datasets for evaluating face obfuscation methods has been a challenge, with every method being tested using arbitrary experiments, datasets, and metrics. While prior work has d…
Adversarial RobustnessFace DetectionFace RecognitionFairnessAirDet: Few-Shot Detection without Fine-tuning for Autonomous Exploration
Few-shot object detection has attracted increasing attention and rapidly progressed in recent years. However, the requirement of an exhaustive offline fine-tuning stage in existing methods is time-consuming and significa…
Few-Shot Object DetectionMeta-Learningobject-detectionObject DetectionFairDgcl: Fairness-aware Recommendation with Dynamic Graph Contrastive Learning
As trustworthy AI continues to advance, the fairness issue in recommendations has received increasing attention. A recommender system is considered unfair when it produces unequal outcomes for different user groups based…
Contrastive LearningData AugmentationFairnessRecommendation SystemsPairDETR : Joint Detection and Association of Human Bodies and Faces
Image and video analysis requires not only accurate object but also the understanding of relationships among detected objects. Common solutions to relation modeling typically resort to stand-alone object detectors fo…
Objectobject-detectionObject DetectionDeep Multimodal Image-Repurposing Detection
Nefarious actors on social media and other platforms often spread rumors and falsehoods through images whose metadata (e.g., captions) have been modified to provide visual substantiation of the rumor/falsehood. This type…