Exploring Depth Information for Face Manipulation Detection
Face manipulation detection has been receiving a lot of attention for the reliability and security of the face images. Recent studies focus on using auxiliary information or prior knowledge to capture robust manipulation traces, which are shown to be promising. As one of the important face features, the face depth map, which has shown to be effective in other areas such as the face recognition or face detection, is unfortunately paid little attention to in literature for detecting the manipulated face images. In this paper, we explore the possibility of incorporating the face depth map as auxiliary information to tackle the problem of face manipulation detection in real world applications. To this end, we first propose a Face Depth Map Transformer (FDMT) to estimate the face depth map patch by patch from a RGB face image, which is able to capture the local depth anomaly created due to manipulation. The estimated face depth map is then considered as auxiliary information to be integrated with the backbone features using a Multi-head Depth Attention (MDA) mechanism that is newly designed. Various experiments demonstrate the advantage of our proposed method for face manipulation detection.
Code (0)
등록된 구현이 없습니다.
Tasks
Face DetectionFace RecognitionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Exploring Depth Information for Detecting Manipulated Face Videos
Face manipulation detection has been receiving a lot of attention for the reliability and security of the face images/videos. Recent studies focus on using auxiliary information or prior knowledge to capture robust manip…
Face DetectionFace RecognitionMIPD: Exploring Manipulation and Intention In a Novel Corpus of Polish Disinformation
This study presents a novel corpus of 15,356 Polish web articles, including articles identified as containing disinformation. Our dataset enables a multifaceted understanding of disinformation. We present a distinctive m…
ArticlesClassificationMulti-spectral Class Center Network for Face Manipulation Detection and Localization
As deepfake content proliferates online, advancing face manipulation forensics has become crucial. To combat this emerging threat, previous methods mainly focus on studying how to distinguish authentic and manipulated fa…
Face SwappingAttending Generalizability in Course of Deep Fake Detection by Exploring Multi-task Learning
This work explores various ways of exploring multi-task learning (MTL) techniques aimed at classifying videos as original or manipulated in cross-manipulation scenario to attend generalizability in deep fake scenario. Th…
Multi-Task LearningExploring Saliency Bias in Manipulation Detection
The social media-fuelled explosion of fake news and misinformation supported by tampered images has led to growth in the development of models and datasets for image manipulation detection. However, existing detection me…
Image ManipulationImage Manipulation DetectionMisinformation