paper-with-me

Papers

Survey on 3D face reconstruction from uncalibrated images

2020-11-11 · Araceli Morales, Gemma Piella, Federico M. Sukno

Recently, a lot of attention has been focused on the incorporation of 3D data into face analysis and its applications. Despite providing a more accurate representation of the face, 3D facial images are more complex to acquire than 2D pictures. As a consequence, great effort has been invested in developing systems that reconstruct 3D faces from an uncalibrated 2D image. However, the 3D-from-2D face reconstruction problem is ill-posed, thus prior knowledge is needed to restrict the solutions space. In this work, we review 3D face reconstruction methods proposed in the last decade, focusing on those that only use 2D pictures captured under uncontrolled conditions. We present a classification of the proposed methods based on the technique used to add prior knowledge, considering three main strategies, namely, statistical model fitting, photometry, and deep learning, and reviewing each of them separately. In addition, given the relevance of statistical 3D facial models as prior knowledge, we explain the construction procedure and provide a list of the most popular publicly available 3D facial models. After the exhaustive study of 3D-from-2D face reconstruction approaches, we observe that the deep learning strategy is rapidly growing since the last few years, becoming the standard choice in replacement of the widespread statistical model fitting. Unlike the other two strategies, photometry-based methods have decreased in number due to the need for strong underlying assumptions that limit the quality of their reconstructions compared to statistical model fitting and deep learning methods. The review also identifies current challenges and suggests avenues for future research.

📄 PDF Abstract BibTeX arXiv:2011.05740

Code (0)

등록된 구현이 없습니다.

Tasks

3D Face ReconstructionDeep LearningFace ReconstructionSurvey

Similar Papers 제목 키워드 기반

BabyNet: Reconstructing 3D faces of babies from uncalibrated photographs

2022-03-11 · Araceli Morales, Antonio R. Porras, Marius George Linguraru, Gemma Piella 외

We present a 3D face reconstruction system that aims at recovering the 3D facial geometry of babies from uncalibrated photographs, BabyNet. Since the 3D facial geometry of babies differs substantially from that of adults…

3D Face ReconstructionDecoderFace ReconstructionTransfer Learning

Uncalibrated Neural Inverse Rendering for Photometric Stereo of General Surfaces

2020-12-12 · CVPR 2021 1 · Berk Kaya, Suryansh Kumar, Carlos Oliveira, Vittorio Ferrari 외

This paper presents an uncalibrated deep neural network framework for the photometric stereo problem. For training models to solve the problem, existing neural network-based methods either require exact light directions …

Image ReconstructionInverse Rendering

HGGT: Robust and Flexible 3D Hand Mesh Reconstruction from Uncalibrated Images

2026-03-25 · Yumeng Liu, Xiao-Xiao Long, Marc Habermann, Xuanze Yang 외 arxiv

Recovering high-fidelity 3D hand geometry from images is a critical task in computer vision, holding significant value for domains such as robotics, animation and VR/AR. Crucially, scalable applications demand both accur…

Uncalibrated Photometric Stereo by Stepwise Optimization Using Principal Components of Isotropic BRDFs

2016-06-01 · CVPR 2016 6 · Keisuke Midorikawa, Toshihiko Yamasaki, Kiyoharu Aizawa

The uncalibrated photometric stereo problem for non-Lambertian surfaces is challenging because of the large number of unknowns and its ill-posed nature stemming from unknown reflectance functions. We propose a model tha…

SceneFactory: A Workflow-centric and Unified Framework for Incremental Scene Modeling

2024-05-13 · Yijun Yuan, Michael Bleier, Andreas Nüchter

We present SceneFactory, a workflow-centric and unified framework for incremental scene modeling, that conveniently supports a wide range of applications, such as (unposed and/or uncalibrated) multi-view depth estimation…

Depth Estimation