Monocular Facial Appearance Capture in the Wild
We present a new method for reconstructing the appearance properties of human faces from a lightweight capture procedure in an unconstrained environment. Our method recovers the surface geometry, diffuse albedo, specular intensity and specular roughness from a monocular video containing a simple head rotation in-the-wild. Notably, we make no simplifying assumptions on the environment lighting, and we explicitly take visibility and occlusions into account. As a result, our method can produce facial appearance maps that approach the fidelity of studio-based multi-view captures, but with a far easier and cheaper procedure.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
SEREP: Semantic Facial Expression Representation for Robust In-the-Wild Capture and Retargeting
Monocular facial performance capture in-the-wild is challenging due to varied capture conditions, face shapes, and expressions. Most current methods rely on linear 3D Morphable Models, which represent facial expressions …
Domain Adaptation360° Volumetric Portrait Avatar
We propose 360{\deg} Volumetric Portrait (3VP) Avatar, a novel method for reconstructing 360{\deg} photo-realistic portrait avatars of human subjects solely based on monocular video inputs. State-of-the-art monocular ava…
Human ParsingMonocular ReconstructionDeepFaceFlow: In-the-wild Dense 3D Facial Motion Estimation
Dense 3D facial motion capture from only monocular in-the-wild pairs of RGB images is a highly challenging problem with numerous applications, ranging from facial expression recognition to facial reenactment. In this wor…
3D ReconstructionFacial Expression RecognitionFacial Expression Recognition (FER)Motion EstimationFacial Landmark Detection: a Literature Survey
The locations of the fiducial facial landmark points around facial components and facial contour capture the rigid and non-rigid facial deformations due to head movements and facial expressions. They are hence important …
Facial Landmark DetectionregressionSurveyNose, eyes and ears: Head pose estimation by locating facial keypoints
Monocular head pose estimation requires learning a model that computes the intrinsic Euler angles for pose (yaw, pitch, roll) from an input image of human face. Annotating ground truth head pose angles for images in the …
Head Pose EstimationPose Estimation