Beyond Detection: Visual Realism Assessment of Deepfakes
In the era of rapid digitalization and artificial intelligence advancements, the development of DeepFake technology has posed significant security and privacy concerns. This paper presents an effective measure to assess the visual realism of DeepFake videos. We utilize an ensemble of two Convolutional Neural Network (CNN) models: Eva and ConvNext. These models have been trained on the DeepFake Game Competition (DFGC) 2022 dataset and aim to predict Mean Opinion Scores (MOS) from DeepFake videos based on features extracted from sequences of frames. Our method secured the third place in the recent DFGC on Visual Realism Assessment held in conjunction with the 2023 International Joint Conference on Biometrics (IJCB 2023). We provide an over\-view of the models, data preprocessing, and training procedures. We also report the performance of our models against the competition's baseline model and discuss the implications of our findings.
Code (0)
등록된 구현이 없습니다.
Tasks
Face SwappingSimilar Papers 제목 키워드 기반
DREAM: A Benchmark Study for Deepfake photoREalism AssessMent
Deep learning based face-swap videos, widely known as deepfakes, have drawn wide attention due to their threat to information credibility. Recent works mainly focus on the problem of deepfake detection that aims to relia…
DeepFake DetectionDFGC-VRA: DeepFake Game Competition on Visual Realism Assessment
This paper presents the summary report on the DeepFake Game Competition on Visual Realism Assessment (DFGCVRA). Deep-learning based face-swap videos, also known as deepfakes, are becoming more and more realistic and dec…
Face SwappingBeyond the Spectrum: Detecting Deepfakes via Re-Synthesis
The rapid advances in deep generative models over the past years have led to highly {realistic media, known as deepfakes,} that are commonly indistinguishable from real to human eyes. These advances make assessing the au…
ColorizationDenoisingMisinformationSuper-ResolutionVulnerability of Automatic Identity Recognition to Audio-Visual Deepfakes
The task of deepfakes detection is far from being solved by speech or vision researchers. Several publicly available databases of fake synthetic video and speech were built to aid the development of detection methods. Ho…
Face RecognitionFace SwappingSpeaker Recognitiontext-to-speech+2EEG-Features for Generalized Deepfake Detection
Since the advent of Deepfakes in digital media, the development of robust and reliable detection mechanism is urgently called for. In this study, we explore a novel approach to Deepfake detection by utilizing electroence…
DeepFake DetectionEEGFace Swapping