3D Face Reconstruction Using Color Photometric Stereo with Uncalibrated Near Point Lights
We present a new color photometric stereo (CPS) method that recovers high quality, detailed 3D face geometry in a single shot. Our system uses three uncalibrated near point lights of different colors and a single camera. For robust self-calibration of the light sources, we use 3D morphable model (3DMM) and semantic segmentation of facial parts. We address the spectral ambiguity problem by incorporating albedo consensus, albedo similarity, and proxy prior into a unified framework. We avoid the need for spatial constancy of albedo; instead, we use a new measure for albedo similarity that is based on the albedo norm profile. Experiments show that our new approach produces state-of-the-art results from single image with high-fidelity geometry that includes details such as wrinkles.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Face ReconstructionFace ReconstructionSemantic SegmentationSimilar Papers 제목 키워드 기반
Uncalibrated Photometric Stereo by Stepwise Optimization Using Principal Components of Isotropic BRDFs
The uncalibrated photometric stereo problem for non-Lambertian surfaces is challenging because of the large number of unknowns and its ill-posed nature stemming from unknown reflectance functions. We propose a model tha…
MVCPS-NeuS: Multi-view Constrained Photometric Stereo for Neural Surface Reconstruction
Multi-view photometric stereo (MVPS) recovers a high-fidelity 3D shape of a scene by benefiting from both multi-view stereo and photometric stereo. While photometric stereo boosts detailed shape reconstruction it nec…
Surface ReconstructionUncalibrated Neural Inverse Rendering for Photometric Stereo of General Surfaces
This paper presents an uncalibrated deep neural network framework for the photometric stereo problem. For training models to solve the problem, existing neural network-based methods either require exact light directions …
Image ReconstructionInverse RenderingDiLiGenT-Pi: Photometric Stereo for Planar Surfaces with Rich Details - Benchmark Dataset and Beyond
Photometric stereo aims to recover detailed surface shapes from images captured under varying illuminations. However, existing real-world datasets primarily focus on evaluating photometric stereo for general non-Lamb…
3D ReconstructionSurface Normal EstimationSelf-calibrating Photometric Stereo by Neural Inverse Rendering
This paper tackles the task of uncalibrated photometric stereo for 3D object reconstruction, where both the object shape, object reflectance, and lighting directions are unknown. This is an extremely difficult task, and …
3D Object ReconstructionInverse RenderingObjectObject Reconstruction