SIDER: Single-Image Neural Optimization for Facial Geometric Detail Recovery
We present SIDER(Single-Image neural optimization for facial geometric DEtail Recovery), a novel photometric optimization method that recovers detailed facial geometry from a single image in an unsupervised manner. Inspired by classical techniques of coarse-to-fine optimization and recent advances in implicit neural representations of 3D shape, SIDER combines a geometry prior based on statistical models and Signed Distance Functions (SDFs) to recover facial details from single images. First, it estimates a coarse geometry using a morphable model represented as an SDF. Next, it reconstructs facial geometry details by optimizing a photometric loss with respect to the ground truth image. In contrast to prior work, SIDER does not rely on any dataset priors and does not require additional supervision from multiple views, lighting changes or ground truth 3D shape. Extensive qualitative and quantitative evaluation demonstrates that our method achieves state-of-the-art on facial geometric detail recovery, using only a single in-the-wild image.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Pixel3DMM: Versatile Screen-Space Priors for Single-Image 3D Face Reconstruction
We address the 3D reconstruction of human faces from a single RGB image. To this end, we propose Pixel3DMM, a set of highly-generalized vision transformers which predict per-pixel geometric cues in order to constrain the…
3D Face Reconstruction3D ReconstructionDiversityFace Model+1FaceDet3D: Facial Expressions with 3D Geometric Detail Hallucination
Facial Expressions induce a variety of high-level details on the 3D face geometry. For example, a smile causes the wrinkling of cheeks or the formation of dimples, while being angry often causes wrinkling of the forehead…
HallucinationFacial Geometric Feature Extraction for Dimensional Emotion Analysis Using Genetic Programming
Geometric features derived from single static images have the potential to be highly effective for facial emotion analysis, as shape, structure, and spatial relationships are key factors. However, these aspects are rarel…
Arousal EstimationContinuous Affect EstimationEmotion RecognitionValence EstimationFacial Geometric Detail Recovery via Implicit Representation
Learning a dense 3D model with fine-scale details from a single facial image is highly challenging and ill-posed. To address this problem, many approaches fit smooth geometries through facial prior while learning details…
Learning Detailed Face Reconstruction from a Single Image
Reconstructing the detailed geometric structure of a face from a given image is a key to many computer vision and graphics applications, such as motion capture and reenactment. The reconstruction task is challenging as h…
Face ReconstructionObject Recognition