Quantitative Metrics for Evaluating Explanations of Video DeepFake Detectors
The proliferation of DeepFake technology is a rising challenge in today's society, owing to more powerful and accessible generation methods. To counter this, the research community has developed detectors of ever-increasing accuracy. However, the ability to explain the decisions of such models to users is lacking behind and is considered an accessory in large-scale benchmarks, despite being a crucial requirement for the correct deployment of automated tools for content moderation. We attribute the issue to the reliance on qualitative comparisons and the lack of established metrics. We describe a simple set of metrics to evaluate the visual quality and informativeness of explanations of video DeepFake classifiers from a human-centric perspective. With these metrics, we compare common approaches to improve explanation quality and discuss their effect on both classification and explanation performance on the recent DFDC and DFD datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
AttributeFace SwappingInformativenessSimilar Papers 제목 키워드 기반
A Data-Driven Diffusion-based Approach for Audio Deepfake Explanations
Evaluating explainability techniques, such as SHAP and LRP, in the context of audio deepfake detection is challenging due to lack of clear ground truth annotations. In the cases when we are able to obtain the ground trut…
Audio Deepfake DetectionDeepFake DetectionFace SwappingWWW: Where, Which and Whatever Enhancing Interpretability in Multimodal Deepfake Detection
All current benchmarks for multimodal deepfake detection manipulate entire frames using various generation techniques, resulting in oversaturated detection accuracies exceeding 94% at the video-level classification. Howe…
DeepFake DetectionFace SwappingWhat's wrong with this video? Comparing Explainers for Deepfake Detection
Deepfakes are computer manipulated videos where the face of an individual has been replaced with that of another. Software for creating such forgeries is easy to use and ever more popular, causing serious threats to pers…
DeepFake DetectionFace SwappingWhat Does an Audio Deepfake Detector Focus on? A Study in the Time Domain
Adding explanations to audio deepfake detection (ADD) models will boost their real-world application by providing insight on the decision making process. In this paper, we propose a relevancy-based explainable AI (XAI) m…
Audio Deepfake DetectionDecision MakingDeepFake DetectionFace SwappingThe Perceived Fragility of Explanations in Audio Models: Manipulation of Attribution with Unchanged Predictions
This paper investigates the fragility of post-hoc explanation methods in audio deepfake detection. While previous work on explanation manipulation focused on images using standard $L_p$ metrics, we introduce a psychoacou…
Audio Deepfake Detection