paper-with-me

홈 › Papers

3D Face Reconstruction Using Color Photometric Stereo with Uncalibrated Near Point Lights

2019-04-04 · Zhang Chen, Yu Ji, Mingyuan Zhou, Sing Bing Kang, Jingyi Yu

We present a new color photometric stereo (CPS) method that recovers high quality, detailed 3D face geometry in a single shot. Our system uses three uncalibrated near point lights of different colors and a single camera. For robust self-calibration of the light sources, we use 3D morphable model (3DMM) and semantic segmentation of facial parts. We address the spectral ambiguity problem by incorporating albedo consensus, albedo similarity, and proxy prior into a unified framework. We avoid the need for spatial constancy of albedo; instead, we use a new measure for albedo similarity that is based on the albedo norm profile. Experiments show that our new approach produces state-of-the-art results from single image with high-fidelity geometry that includes details such as wrinkles.

📄 PDF Abstract BibTeX arXiv:1904.02605

Code (0)

등록된 구현이 없습니다.

Tasks

3D Face ReconstructionFace ReconstructionSemantic Segmentation

Similar Papers 제목 키워드 기반

Uncalibrated Photometric Stereo by Stepwise Optimization Using Principal Components of Isotropic BRDFs

2016-06-01 · CVPR 2016 6 · Keisuke Midorikawa, Toshihiko Yamasaki, Kiyoharu Aizawa

The uncalibrated photometric stereo problem for non-Lambertian surfaces is challenging because of the large number of unknowns and its ill-posed nature stemming from unknown reflectance functions. We propose a model tha…

MVCPS-NeuS: Multi-view Constrained Photometric Stereo for Neural Surface Reconstruction

2024-01-01 · CVPR 2024 1 · Hiroaki Santo, Fumio Okura, Yasuyuki Matsushita

Multi-view photometric stereo (MVPS) recovers a high-fidelity 3D shape of a scene by benefiting from both multi-view stereo and photometric stereo. While photometric stereo boosts detailed shape reconstruction it nec…

Surface Reconstruction

Uncalibrated Neural Inverse Rendering for Photometric Stereo of General Surfaces

2020-12-12 · CVPR 2021 1 · Berk Kaya, Suryansh Kumar, Carlos Oliveira, Vittorio Ferrari 외

This paper presents an uncalibrated deep neural network framework for the photometric stereo problem. For training models to solve the problem, existing neural network-based methods either require exact light directions …

Image ReconstructionInverse Rendering

DiLiGenT-Pi: Photometric Stereo for Planar Surfaces with Rich Details - Benchmark Dataset and Beyond

2023-01-01 · ICCV 2023 1 · Feishi Wang, Jieji Ren, Heng Guo, Mingjun Ren 외

Photometric stereo aims to recover detailed surface shapes from images captured under varying illuminations. However, existing real-world datasets primarily focus on evaluating photometric stereo for general non-Lamb…

3D ReconstructionSurface Normal Estimation

Self-calibrating Photometric Stereo by Neural Inverse Rendering

2022-07-16 · Junxuan Li, Hongdong Li

This paper tackles the task of uncalibrated photometric stereo for 3D object reconstruction, where both the object shape, object reflectance, and lighting directions are unknown. This is an extremely difficult task, and …

3D Object ReconstructionInverse RenderingObjectObject Reconstruction