Joint 3D Face Reconstruction and Dense Alignment with Position Map Regression Network
We propose a straightforward method that simultaneously reconstructs the 3D facial structure and provides dense alignment. To achieve this, we design a 2D representation called UV position map which records the 3D shape of a complete face in UV space, then train a simple Convolutional Neural Network to regress it from a single 2D image. We also integrate a weight mask into the loss function during training to improve the performance of the network. Our method does not rely on any prior face model, and can reconstruct full facial geometry along with semantic meaning. Meanwhile, our network is very light-weighted and spends only 9.8ms to process an image, which is extremely faster than previous works. Experiments on multiple challenging datasets show that our method surpasses other state-of-the-art methods on both reconstruction and alignment tasks by a large margin.
Code (4)
Tasks
3D Face ReconstructionFace AlignmentFace ModelFace ReconstructionPositionregressionSimilar Papers 제목 키워드 기반
Dual Attention MobDenseNet(DAMDNet) for Robust 3D Face Alignment
3D face alignment of monocular images is a crucial process in the recognition of faces with disguise.3D face reconstruction facilitated by alignment can restore the face structure which is helpful in detcting disguise in…
3D Face Alignment3D Face ReconstructionFace AlignmentFace ReconstructionSuperPrimitive: Scene Reconstruction at a Primitive Level
Joint camera pose and dense geometry estimation from a set of images or a monocular video remains a challenging problem due to its computational complexity and inherent visual ambiguities. Most dense incremental reconstr…
3D ReconstructionDepth CompletionVisual OdometryJointly Aligning Millions of Images with Deep Penalised Reconstruction Congealing
Extrapolating fine-grained pixel-level correspondences in a fully unsupervised manner from a large set of misaligned images can benefit several computer vision and graphics problems, e.g. co-segmentation, super-resolutio…
3D ReconstructionSuper-ResolutionSplatFace: Gaussian Splat Face Reconstruction Leveraging an Optimizable Surface
We present SplatFace, a novel Gaussian splatting framework designed for 3D human face reconstruction without reliance on accurate pre-determined geometry. Our method is designed to simultaneously deliver both high-qualit…
3D ReconstructionFace ReconstructionNovel View Synthesis3D Dense Face Alignment via Graph Convolution Networks
Recently, 3D face reconstruction and face alignment tasks are gradually combined into one task: 3D dense face alignment. Its goal is to reconstruct the 3D geometric structure of face with pose information. In this paper,…
3D Face ReconstructionFace AlignmentFace Reconstruction