paper-with-me

홈 › Papers

Exploring Depth Information for Face Manipulation Detection

2022-12-29 · Haoyue Wang, Meiling Li, Sheng Li, Zhenxing Qian, Xinpeng Zhang

Face manipulation detection has been receiving a lot of attention for the reliability and security of the face images. Recent studies focus on using auxiliary information or prior knowledge to capture robust manipulation traces, which are shown to be promising. As one of the important face features, the face depth map, which has shown to be effective in other areas such as the face recognition or face detection, is unfortunately paid little attention to in literature for detecting the manipulated face images. In this paper, we explore the possibility of incorporating the face depth map as auxiliary information to tackle the problem of face manipulation detection in real world applications. To this end, we first propose a Face Depth Map Transformer (FDMT) to estimate the face depth map patch by patch from a RGB face image, which is able to capture the local depth anomaly created due to manipulation. The estimated face depth map is then considered as auxiliary information to be integrated with the backbone features using a Multi-head Depth Attention (MDA) mechanism that is newly designed. Various experiments demonstrate the advantage of our proposed method for face manipulation detection.

📄 PDF Abstract BibTeX arXiv:2212.14230

Code (0)

등록된 구현이 없습니다.

Tasks

Face DetectionFace Recognition

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Adam 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Similar Papers 제목 키워드 기반

Exploring Depth Information for Detecting Manipulated Face Videos

2024-11-27 · Haoyue Wang, Sheng Li, Ji He, Zhenxing Qian 외

Face manipulation detection has been receiving a lot of attention for the reliability and security of the face images/videos. Recent studies focus on using auxiliary information or prior knowledge to capture robust manip…

Face DetectionFace Recognition

MIPD: Exploring Manipulation and Intention In a Novel Corpus of Polish Disinformation

2024-11-11 · Empirical Methods in Natural Language Processing (EMNLP) 2024 11 · Arkadiusz Modzelewski, Giovanni Da San Martino, Pavel Savov, Magdalena Anna Wilczyńska 외

This study presents a novel corpus of 15,356 Polish web articles, including articles identified as containing disinformation. Our dataset enables a multifaceted understanding of disinformation. We present a distinctive m…

ArticlesClassification

Multi-spectral Class Center Network for Face Manipulation Detection and Localization

2023-05-18 · Changtao Miao, Qi Chu, Zhentao Tan, Zhenchao Jin 외

As deepfake content proliferates online, advancing face manipulation forensics has become crucial. To combat this emerging threat, previous methods mainly focus on studying how to distinguish authentic and manipulated fa…

Face Swapping

Attending Generalizability in Course of Deep Fake Detection by Exploring Multi-task Learning

2023-08-25 · Pranav Balaji, Abhijit Das, Srijan Das, Antitza Dantcheva

This work explores various ways of exploring multi-task learning (MTL) techniques aimed at classifying videos as original or manipulated in cross-manipulation scenario to attend generalizability in deep fake scenario. Th…

Multi-Task Learning

Exploring Saliency Bias in Manipulation Detection

2024-02-12 · Joshua Krinsky, Alan Bettis, Qiuyu Tang, Daniel Moreira 외

The social media-fuelled explosion of fake news and misinformation supported by tampered images has led to growth in the development of models and datasets for image manipulation detection. However, existing detection me…

Image ManipulationImage Manipulation DetectionMisinformation