Image Forgery Detection with Interpretability
In this work, we present a learning based method focusing on the convolutional neural network (CNN) architecture to detect these forgeries. We consider the detection of both copy-move forgeries and inpainting based forgeries. For these, we synthesize our own large dataset. In addition to classification, the focus is also on interpretability of the forgery detection. As the CNN classification yields the image-level label, it is important to understand if forged region has indeed contributed to the classification. For this purpose, we demonstrate using the Grad-CAM heatmap, that in various correctly classified examples, that the forged region is indeed the region contributing to the classification. Interestingly, this is also applicable for small forged regions, as is depicted in our results. Such an analysis can also help in establishing the reliability of the classification.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationImage Forgery DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
FOCA: Frequency-Oriented Cross-Domain Forgery Detection, Localization and Explanation via Multi-Modal Large Language Model
Advances in image tampering techniques, particularly generative models, pose significant challenges to media verification, digital forensics, and public trust. Existing image forgery detection and localization (IFDL) met…
Rethinking VLMs for Image Forgery Detection and Localization
With the rapid rise of Artificial Intelligence Generated Content (AIGC), image manipulation has become increasingly accessible, posing significant challenges for image forgery detection and localization (IFDL). In this p…
Image ManipulationTowards General Visual-Linguistic Face Forgery Detection
Deepfakes are realistic face manipulations that can pose serious threats to security, privacy, and trust. Existing methods mostly treat this task as binary classification, which uses digital labels or mask signals to tra…
Binary ClassificationDeepFake DetectionFace SwappingSentenceDDL: A Dataset for Interpretable Deepfake Detection and Localization in Real-World Scenarios
Recent advances in AIGC have exacerbated the misuse of malicious deepfake content, making the development of reliable deepfake detection methods an essential means to address this challenge. Although existing deepfake de…
Binary ClassificationDeepFake DetectionFace SwappingMGFFD-VLM: Multi-Granularity Prompt Learning for Face Forgery Detection with VLM
Recent studies have utilized visual large language models (VLMs) to answer not only "Is this face a forgery?" but also "Why is the face a forgery?" These studies introduced forgery-related attributes, such as forgery loc…
AttributeFace SwappingPrompt LearningVisual Question Answering (VQA)