A Morphable Face Albedo Model
In this paper, we bring together two divergent strands of research: photometric face capture and statistical 3D face appearance modelling. We propose a novel lightstage capture and processing pipeline for acquiring ear-to-ear, truly intrinsic diffuse and specular albedo maps that fully factor out the effects of illumination, camera and geometry. Using this pipeline, we capture a dataset of 50 scans and combine them with the only existing publicly available albedo dataset (3DRFE) of 23 scans. This allows us to build the first morphable face albedo model. We believe this is the first statistical analysis of the variability of facial specular albedo maps. This model can be used as a plug in replacement for the texture model of the Basel Face Model (BFM) or FLAME and we make the model publicly available. We ensure careful spectral calibration such that our model is built in a linear sRGB space, suitable for inverse rendering of images taken by typical cameras. We demonstrate our model in a state of the art analysis-by-synthesis 3DMM fitting pipeline, are the first to integrate specular map estimation and outperform the BFM in albedo reconstruction.
Code (1)
Tasks
Art AnalysisFace ModelInverse RenderingmodelSimilar Papers 제목 키워드 기반
On Learning 3D Face Morphable Model from In-the-wild Images
As a classic statistical model of 3D facial shape and albedo, 3D Morphable Model (3DMM) is widely used in facial analysis, e.g., model fitting, image synthesis. Conventional 3DMM is learned from a set of 3D face scans wi…
3D ReconstructionFace AlignmentImage GenerationLearning a 3D Morphable Face Reflectance Model from Low-cost Data
Modeling non-Lambertian effects such as facial specularity leads to a more realistic 3D Morphable Face Model. Existing works build parametric models for diffuse and specular albedo using Light Stage data. However, only d…
Face ModelInverse RenderingBuilding 3D Morphable Models from a Single Scan
We propose a method for constructing generative models of 3D objects from a single 3D mesh. Our method produces a 3D morphable model that represents shape and albedo in terms of Gaussian processes. We define the shape de…
Face RecognitionGaussian ProcessesInverse Rendering3D Face Reconstruction Using Color Photometric Stereo with Uncalibrated Near Point Lights
We present a new color photometric stereo (CPS) method that recovers high quality, detailed 3D face geometry in a single shot. Our system uses three uncalibrated near point lights of different colors and a single camera.…
3D Face ReconstructionFace ReconstructionSemantic SegmentationLearning Complete 3D Morphable Face Models from Images and Videos
Most 3D face reconstruction methods rely on 3D morphable models, which disentangle the space of facial deformations into identity geometry, expressions and skin reflectance. These models are typically learned from a limi…
3D Face ReconstructionFace ReconstructionMonocular ReconstructionSelf-Supervised Learning