paper-with-me

Papers

3D Facial Geometry Recovery from a Depth View with Attention Guided Generative Adversarial Network

2020-09-02 · Xiaoxu Cai, Hui Yu, Jianwen Lou, Xuguang Zhang, Gongfa Li, Junyu Dong

We present to recover the complete 3D facial geometry from a single depth view by proposing an Attention Guided Generative Adversarial Networks (AGGAN). In contrast to existing work which normally requires two or more depth views to recover a full 3D facial geometry, the proposed AGGAN is able to generate a dense 3D voxel grid of the face from a single unconstrained depth view. Specifically, AGGAN encodes the 3D facial geometry within a voxel space and utilizes an attention-guided GAN to model the illposed 2.5D depth-3D mapping. Multiple loss functions, which enforce the 3D facial geometry consistency, together with a prior distribution of facial surface points in voxel space are incorporated to guide the training process. Both qualitative and quantitative comparisons show that AGGAN recovers a more complete and smoother 3D facial shape, with the capability to handle a much wider range of view angles and resist to noise in the depth view than conventional methods

📄 PDF Abstract BibTeX arXiv:2009.00938

Code (0)

등록된 구현이 없습니다.

Tasks

Generative Adversarial Network

Similar Papers 제목 키워드 기반

SIDER: Single-Image Neural Optimization for Facial Geometric Detail Recovery

2021-08-11 · Aggelina Chatziagapi, ShahRukh Athar, Francesc Moreno-Noguer, Dimitris Samaras

We present SIDER(Single-Image neural optimization for facial geometric DEtail Recovery), a novel photometric optimization method that recovers detailed facial geometry from a single image in an unsupervised manner. Inspi…

Face Anything: 4D Face Reconstruction from Any Image Sequence

2026-04-21 · Umut Kocasari, Simon Giebenhain, Richard Shaw, Matthias Nießner arxiv

Accurate reconstruction and tracking of dynamic human faces from image sequences is challenging because non-rigid deformations, expression changes, and viewpoint variations occur simultaneously, creating significant ambi…

Dynamic ReconstructionDepth EstimationPoint Tracking

Unsupervised Depth Estimation, 3D Face Rotation and Replacement

2018-03-25 · NeurIPS 2018 12 · Joel Ruben Antony Moniz, Christopher Beckham, Simon Rajotte, Sina Honari 외

We present an unsupervised approach for learning to estimate three dimensional (3D) facial structure from a single image while also predicting 3D viewpoint transformations that match a desired pose and facial geometry. W…

Depth EstimationTranslation

DaGAN++: Depth-Aware Generative Adversarial Network for Talking Head Video Generation

2023-05-10 · Fa-Ting Hong, Li Shen, Dan Xu

Predominant techniques on talking head generation largely depend on 2D information, including facial appearances and motions from input face images. Nevertheless, dense 3D facial geometry, such as pixel-wise depth, plays…

3D geometryGenerative Adversarial NetworkKeypoint EstimationTalking Head Generation+1

2D+3D Facial Expression Recognition via Discriminative Dynamic Range Enhancement and Multi-Scale Learning

2020-11-16 · Yang Jiao, Yi Niu, Trac D. Tran, Guangming Shi

In 2D+3D facial expression recognition (FER), existing methods generate multi-view geometry maps to enhance the depth feature representation. However, this may introduce false estimations due to local plane fitting from …

3D Facial Expression RecognitionFacial Expression RecognitionFacial Expression Recognition (FER)