paper-with-me

Papers

Pareidolia Face Reenactment

2021-06-19 · CVPR 2021 1 · Linsen Song, Wayne Wu, Chaoyou Fu, Chen Qian, Chen Change Loy, Ran He

We present a new application direction named Pareidolia Face Reenactment, which is defined as animating a static illusory face to move in tandem with a human face in the video. For the large differences between pareidolia face reenactment and traditional human face reenactment, two main challenges are introduced, i.e., shape variance and texture variance. In this work, we propose a novel Parametric Unsupervised Reenactment Algorithm to tackle these two challenges. Specifically, we propose to decompose the reenactment into three catenate processes: shape modeling, motion transfer and texture synthesis. With the decomposition, we introduce three crucial components, i.e., Parametric Shape Modeling, Expansionary Motion Transfer and Unsupervised Texture Synthesizer, to overcome the problems brought by the remarkably variances on pareidolia faces. Extensive experiments show the superior performance of our method both qualitatively and quantitatively. Code, model and data are available on our project page.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Face ReenactmentTexture Synthesis

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Attention 설명 없음
Synthesizer 설명 없음

Similar Papers 제목 키워드 기반

Everything's Talkin': Pareidolia Face Reenactment

2021-04-07 · Linsen Song, Wayne Wu, Chaoyou Fu, Chen Qian 외

We present a new application direction named Pareidolia Face Reenactment, which is defined as animating a static illusory face to move in tandem with a human face in the video. For the large differences between pareidoli…

Face ReenactmentTexture Synthesis

Seeing Faces in Things: A Model and Dataset for Pareidolia

2024-09-24 · Mark Hamilton, Simon Stent, Vasha DuTell, Anne Harrington 외

The human visual system is well-tuned to detect faces of all shapes and sizes. While this brings obvious survival advantages, such as a better chance of spotting unknown predators in the bush, it also leads to spurious f…

When Visual Evidence is Ambiguous: Pareidolia as a Diagnostic Probe for Vision Models

2026-03-04 · Qianpu Chen, Derya Soydaner, Rob Saunders arxiv

When visual evidence is ambiguous, vision models must decide how to interpret face-like patterns. Face pareidolia, the perception of faces in non-face objects, provides a controlled probe of such decisions. We introduce …

Object DetectionFace Detection

Single Source One Shot Reenactment using Weighted motion From Paired Feature Points

2021-04-07 · Soumya Tripathy, Juho Kannala, Esa Rahtu

Image reenactment is a task where the target object in the source image imitates the motion represented in the driving image. One of the most common reenactment tasks is face image animation. The major challenge in the c…

Face ReenactmentImage Animation

FACEGAN: Facial Attribute Controllable rEenactment GAN

2020-11-09 · Soumya Tripathy, Juho Kannala, Esa Rahtu

The face reenactment is a popular facial animation method where the person's identity is taken from the source image and the facial motion from the driving image. Recent works have demonstrated high quality results by co…

AttributeFace Reenactment