paper-with-me

Papers

DeePhy: On Deepfake Phylogeny

2022-09-19 · Kartik Narayan, Harsh Agarwal, Kartik Thakral, Surbhi Mittal, Mayank Vatsa, Richa Singh

Deepfake refers to tailored and synthetically generated videos which are now prevalent and spreading on a large scale, threatening the trustworthiness of the information available online. While existing datasets contain different kinds of deepfakes which vary in their generation technique, they do not consider progression of deepfakes in a "phylogenetic" manner. It is possible that an existing deepfake face is swapped with another face. This process of face swapping can be performed multiple times and the resultant deepfake can be evolved to confuse the deepfake detection algorithms. Further, many databases do not provide the employed generative model as target labels. Model attribution helps in enhancing the explainability of the detection results by providing information on the generative model employed. In order to enable the research community to address these questions, this paper proposes DeePhy, a novel Deepfake Phylogeny dataset which consists of 5040 deepfake videos generated using three different generation techniques. There are 840 videos of one-time swapped deepfakes, 2520 videos of two-times swapped deepfakes and 1680 videos of three-times swapped deepfakes. With over 30 GBs in size, the database is prepared in over 1100 hours using 18 GPUs of 1,352 GB cumulative memory. We also present the benchmark on DeePhy dataset using six deepfake detection algorithms. The results highlight the need to evolve the research of model attribution of deepfakes and generalize the process over a variety of deepfake generation techniques. The database is available at: http://iab-rubric.org/deephy-database

📄 PDF Abstract BibTeX arXiv:2209.09111

Code (0)

등록된 구현이 없습니다.

Tasks

DeepFake DetectionFace Swapping

Similar Papers 제목 키워드 기반

Deephys: Deep Electrophysiology, Debugging Neural Networks under Distribution Shifts

2023-03-17 · Anirban Sarkar, Matthew Groth, Ian Mason, Tomotake Sasaki 외

Deep Neural Networks (DNNs) often fail in out-of-distribution scenarios. In this paper, we introduce a tool to visualize and understand such failures. We draw inspiration from concepts from neural electrophysiology, whic…

PROMT DeepHybrid system for WMT12 shared translation task

2012-06-01 · WS 2012 6 · Alex Molchanov, er
Language ModellingMachine TranslationTranslation

MorDeephy: Face Morphing Detection Via Fused Classification

2022-08-05 · Iurii Medvedev, Farhad Shadmand, Nuno Gonçalves

Face morphing attack detection (MAD) is one of the most challenging tasks in the field of face recognition nowadays. In this work, we introduce a novel deep learning strategy for a single image face morphing detection, w…

ClassificationFace Morphing Attack DetectionFace Recognition

Phylogeny-informed fitness estimation

2023-06-06 · Alexander Lalejini, Matthew Andres Moreno, Jose Guadalupe Hernandez, Emily Dolson

Phylogenies (ancestry trees) depict the evolutionary history of an evolving population. In evolutionary computing, a phylogeny can reveal how an evolutionary algorithm steers a population through a search space, illumina…

DiagnosticDiversityEvolutionary Algorithms

Runtime phylogenetic analysis enables extreme subsampling for test-based problems

2024-02-02 · Alexander Lalejini, Marcos Sanson, Jack Garbus, Matthew Andres Moreno 외

A phylogeny describes the evolutionary history of an evolving population. Evolutionary search algorithms can perfectly track the ancestry of candidate solutions, illuminating a population's trajectory through the search …

DiagnosticProgram Synthesis