paper-with-me

Papers

Quantitative Metrics for Evaluating Explanations of Video DeepFake Detectors

2022-10-07 · Federico Baldassarre, Quentin Debard, Gonzalo Fiz Pontiveros, Tri Kurniawan Wijaya

The proliferation of DeepFake technology is a rising challenge in today's society, owing to more powerful and accessible generation methods. To counter this, the research community has developed detectors of ever-increasing accuracy. However, the ability to explain the decisions of such models to users is lacking behind and is considered an accessory in large-scale benchmarks, despite being a crucial requirement for the correct deployment of automated tools for content moderation. We attribute the issue to the reliance on qualitative comparisons and the lack of established metrics. We describe a simple set of metrics to evaluate the visual quality and informativeness of explanations of video DeepFake classifiers from a human-centric perspective. With these metrics, we compare common approaches to improve explanation quality and discuss their effect on both classification and explanation performance on the recent DFDC and DFD datasets.

📄 PDF Abstract BibTeX arXiv:2210.03683

Code (0)

등록된 구현이 없습니다.

Tasks

AttributeFace SwappingInformativeness

Similar Papers 제목 키워드 기반

A Data-Driven Diffusion-based Approach for Audio Deepfake Explanations

2025-06-03 · Petr Grinberg, Ankur Kumar, Surya Koppisetti, Gaurav Bharaj

Evaluating explainability techniques, such as SHAP and LRP, in the context of audio deepfake detection is challenging due to lack of clear ground truth annotations. In the cases when we are able to obtain the ground trut…

Audio Deepfake DetectionDeepFake DetectionFace Swapping

WWW: Where, Which and Whatever Enhancing Interpretability in Multimodal Deepfake Detection

2024-08-06 · Juho Jung, Sangyoun Lee, Jooeon Kang, Yunjin Na

All current benchmarks for multimodal deepfake detection manipulate entire frames using various generation techniques, resulting in oversaturated detection accuracies exceeding 94% at the video-level classification. Howe…

DeepFake DetectionFace Swapping

What's wrong with this video? Comparing Explainers for Deepfake Detection

2021-05-12 · Samuele Pino, Mark James Carman, Paolo Bestagini

Deepfakes are computer manipulated videos where the face of an individual has been replaced with that of another. Software for creating such forgeries is easy to use and ever more popular, causing serious threats to pers…

DeepFake DetectionFace Swapping

What Does an Audio Deepfake Detector Focus on? A Study in the Time Domain

2025-01-23 · Petr Grinberg, Ankur Kumar, Surya Koppisetti, Gaurav Bharaj

Adding explanations to audio deepfake detection (ADD) models will boost their real-world application by providing insight on the decision making process. In this paper, we propose a relevancy-based explainable AI (XAI) m…

Audio Deepfake DetectionDecision MakingDeepFake DetectionFace Swapping

The Perceived Fragility of Explanations in Audio Models: Manipulation of Attribution with Unchanged Predictions

2026-06-12 · Piotr Kitłowski, Dominik Wiącek, Mateusz Modrzejewski arxiv

This paper investigates the fragility of post-hoc explanation methods in audio deepfake detection. While previous work on explanation manipulation focused on images using standard $L_p$ metrics, we introduce a psychoacou…

Audio Deepfake Detection