Robust Geometry and Reflectance Disentanglement for 3D Face Reconstruction from Sparse-view Images
This paper presents a novel two-stage approach for reconstructing human faces from sparse-view images, a task made challenging by the unique geometry and complex skin reflectance of each individual. Our method focuses on decomposing key facial attributes, including geometry, diffuse reflectance, and specular reflectance, from ambient light. Initially, we create a general facial template from a diverse collection of individual faces, capturing essential geometric and reflectance characteristics. Guided by this template, we refine each specific face model in the second stage, which further considers the interaction between geometry and reflectance, as well as the subsurface scattering effects on facial skin. Our method enables the reconstruction of high-quality facial representations from as few as three images, offering improved geometric accuracy and reflectance detail. Through comprehensive evaluations and comparisons, our method demonstrates superiority over existing techniques. Our method effectively disentangles geometry and reflectance components, leading to enhanced quality in synthesizing new views and opening up possibilities for applications such as relighting and reflectance editing. We will make the code publicly available.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Face ReconstructionDisentanglementFace ModelFace ReconstructionSimilar Papers 제목 키워드 기반
Fast and Physically-based Neural Explicit Surface for Relightable Human Avatars
Efficiently modeling relightable human avatars from sparse-view videos is crucial for AR/VR applications. Current methods use neural implicit representations to capture dynamic geometry and reflectance, which incur high …
DisentanglementSFDM: Robust Decomposition of Geometry and Reflectance for Realistic Face Rendering from Sparse-view Images
In this study, we introduce a novel two-stage technique for decomposing and reconstructing facial features from sparse-view images, a task made challenging by the unique geometry and complex skin reflectance of each …
Deep 3D Capture: Geometry and Reflectance from Sparse Multi-View Images
We introduce a novel learning-based method to reconstruct the high-quality geometry and complex, spatially-varying BRDF of an arbitrary object from a sparse set of only six images captured by wide-baseline cameras under …
S2F2: Self-Supervised High Fidelity Face Reconstruction from Monocular Image
We present a novel face reconstruction method capable of reconstructing detailed face geometry, spatially varying face reflectance from a single monocular image. We build our work upon the recent advances of DNN-based au…
3D Face ReconstructionFace ReconstructionSelf-Supervised LearningVocal Bursts Intensity PredictionMulti-view 3D Reconstruction of a Texture-less Smooth Surface of Unknown Generic Reflectance
Recovering the 3D geometry of a purely texture-less object with generally unknown surface reflectance (e.g. non-Lambertian) is regarded as a challenging task in multi-view reconstruction. The major obstacle revolves arou…
3D geometry3D Object Reconstruction3D ReconstructionBRDF estimation+1