Self-calibrating Deep Photometric Stereo Networks
This paper proposes an uncalibrated photometric stereo method for non-Lambertian scenes based on deep learning. Unlike previous approaches that heavily rely on assumptions of specific reflectances and light source distributions, our method is able to determine both shape and light directions of a scene with unknown arbitrary reflectances observed under unknown varying light directions. To achieve this goal, we propose a two-stage deep learning architecture, called SDPS-Net, which can effectively take advantage of intermediate supervision, resulting in reduced learning difficulty compared to a single-stage model. Experiments on both synthetic and real datasets show that our proposed approach significantly outperforms previous uncalibrated photometric stereo methods.
Code (1)
Tasks
Deep LearningSimilar Papers 제목 키워드 기반
Self-calibrating Photometric Stereo by Neural Inverse Rendering
This paper tackles the task of uncalibrated photometric stereo for 3D object reconstruction, where both the object shape, object reflectance, and lighting directions are unknown. This is an extremely difficult task, and …
3D Object ReconstructionInverse RenderingObjectObject ReconstructionMVCPS-NeuS: Multi-view Constrained Photometric Stereo for Neural Surface Reconstruction
Multi-view photometric stereo (MVPS) recovers a high-fidelity 3D shape of a scene by benefiting from both multi-view stereo and photometric stereo. While photometric stereo boosts detailed shape reconstruction it nec…
Surface ReconstructionCalibrating Photometric Stereo by Holistic Reflectance Symmetry Analysis
Under unknown directional lighting, the uncalibrated Lambertian photometric stereo algorithm recovers the shape of a smooth surface up to the generalized bas-relief (GBR) ambiguity. We resolve this ambiguity from the hal…
A Non-Convex Variational Approach to Photometric Stereo Under Inaccurate Lighting
This paper tackles the photometric stereo problem in the presence of inaccurate lighting, obtained either by calibration or by an uncalibrated photometric stereo method. Based on a precise modeling of noise and outliers,…
DeepPS2: Revisiting Photometric Stereo Using Two Differently Illuminated Images
Photometric stereo, a problem of recovering 3D surface normals using images of an object captured under different lightings, has been of great interest and importance in computer vision research. Despite the success of e…
Image ReconstructionImage RelightingInverse RenderingLighting Estimation+1