paper-with-me

홈 › Papers

Towards Quantitative Evaluation of Explainable AI Methods for Deepfake Detection

2024-04-29 · Konstantinos Tsigos, Evlampios Apostolidis, Spyridon Baxevanakis, Symeon Papadopoulos, Vasileios Mezaris

In this paper we propose a new framework for evaluating the performance of explanation methods on the decisions of a deepfake detector. This framework assesses the ability of an explanation method to spot the regions of a fake image with the biggest influence on the decision of the deepfake detector, by examining the extent to which these regions can be modified through a set of adversarial attacks, in order to flip the detector's prediction or reduce its initial prediction; we anticipate a larger drop in deepfake detection accuracy and prediction, for methods that spot these regions more accurately. Based on this framework, we conduct a comparative study using a state-of-the-art model for deepfake detection that has been trained on the FaceForensics++ dataset, and five explanation methods from the literature. The findings of our quantitative and qualitative evaluations document the advanced performance of the LIME explanation method against the other compared ones, and indicate this method as the most appropriate for explaining the decisions of the utilized deepfake detector.

📄 PDF Abstract BibTeX arXiv:2404.18649

Code (1)

idt-iti/xai-deepfakes 공식 구현 pytorch

Tasks

DeepFake DetectionFace SwappingPrediction

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
LIME LIME, or Local Interpretable Model-Agnostic Explanations, is an algorithm that can explain the predictions of any classifier or regressor in a faithful way, by…
FLIP https://developer.nvidia.com/blog/flip-a-difference-evaluator-for-alternating-images/

Similar Papers 제목 키워드 기반

MARE: Multimodal Alignment and Reinforcement for Explainable Deepfake Detection via Vision-Language Models

2026-01-28 · Wenbo Xu, Wei Lu, Xiangyang Luo, Jiantao Zhou arxiv

Deepfake detection is a widely researched topic that is crucial for combating the spread of malicious content, with existing methods mainly modeling the problem as classification or spatial localization. The rapid advanc…

Reinforcement LearningDeepFake Detection

An adversarial attack approach for eXplainable AI evaluation on deepfake detection models

2023-12-08 · Balachandar Gowrisankar, Vrizlynn L. L. Thing

With the rising concern on model interpretability, the application of eXplainable AI (XAI) tools on deepfake detection models has been a topic of interest recently. In image classification tasks, XAI tools highlight pixe…

Adversarial AttackDeepFake DetectionFace Swappingimage-classification+1

Explainable Deepfake Detection Challenge

2026-07-23 · Abhijeet Narang, Kartik Kuckreja, Shreya Ghosh, Muhammad Haris Khan 외 arxiv

Deepfake detection is moving beyond binary classification decisions toward systems that can also explain the visual evidence supporting those decisions. This transition is important for real-world verification settings, …

Explanation GenerationBinary ClassificationImage ClassificationSemantic Similarity

ExDDV: A New Dataset for Explainable Deepfake Detection in Video

2025-03-18 · Vlad Hondru, Eduard Hogea, Darian Onchis, Radu Tudor Ionescu

The ever growing realism and quality of generated videos makes it increasingly harder for humans to spot deepfake content, who need to rely more and more on automatic deepfake detectors. However, deepfake detectors are a…

DeepFake DetectionExplainable ModelsFace SwappingIn-Context Learning+1

EDVD-LLaMA: Explainable Deepfake Video Detection via Multimodal Large Language Model Reasoning

2025-10-18 · Haoran Sun, Chen Cai, Huiping Zhuang, Kong Aik Lee 외 arxiv

The rapid development of deepfake video technology has not only facilitated artistic creation but also made it easier to spread misinformation. Traditional deepfake video detection (DVD) methods face issues such as a lac…