paper-with-me

홈 › Papers

PS-FCN: A Flexible Learning Framework for Photometric Stereo

2018-07-23 · ECCV 2018 9 · Guan-Ying Chen, Kai Han, Kwan-Yee K. Wong

This paper addresses the problem of photometric stereo for non-Lambertian surfaces. Existing approaches often adopt simplified reflectance models to make the problem more tractable, but this greatly hinders their applications on real-world objects. In this paper, we propose a deep fully convolutional network, called PS-FCN, that takes an arbitrary number of images of a static object captured under different light directions with a fixed camera as input, and predicts a normal map of the object in a fast feed-forward pass. Unlike the recently proposed learning based method, PS-FCN does not require a pre-defined set of light directions during training and testing, and can handle multiple images and light directions in an order-agnostic manner. Although we train PS-FCN on synthetic data, it can generalize well on real datasets. We further show that PS-FCN can be easily extended to handle the problem of uncalibrated photometric stereo.Extensive experiments on public real datasets show that PS-FCN outperforms existing approaches in calibrated photometric stereo, and promising results are achieved in uncalibrated scenario, clearly demonstrating its effectiveness.

📄 PDF Abstract BibTeX arXiv:1807.08696

Code (1)

guanyingc/PS-FCN 공식 구현 pytorch

Similar Papers 제목 키워드 기반

MERLiN: Single-Shot Material Estimation and Relighting for Photometric Stereo

2024-09-01 · Ashish Tiwari, Satoshi Ikehata, Shanmuganathan Raman

Photometric stereo typically demands intricate data acquisition setups involving multiple light sources to recover surface normals accurately. In this paper, we propose MERLiN, an attention-based hourglass network that i…

Inverse Rendering

DiLiGenT-Pi: Photometric Stereo for Planar Surfaces with Rich Details - Benchmark Dataset and Beyond

2023-01-01 · ICCV 2023 1 · Feishi Wang, Jieji Ren, Heng Guo, Mingjun Ren 외

Photometric stereo aims to recover detailed surface shapes from images captured under varying illuminations. However, existing real-world datasets primarily focus on evaluating photometric stereo for general non-Lamb…

3D ReconstructionSurface Normal Estimation

Deep Learning Methods for Calibrated Photometric Stereo and Beyond

2022-12-16 · Yakun Ju, Kin-Man Lam, Wuyuan Xie, Huiyu Zhou 외

Photometric stereo recovers the surface normals of an object from multiple images with varying shading cues, i.e., modeling the relationship between surface orientation and intensity at each pixel. Photometric stereo pre…

Deep Learning

Differentiable Display Photometric Stereo

2023-06-23 · CVPR 2024 1 · Seokjun Choi, Seungwoo Yoon, Giljoo Nam, Seungyong Lee 외

Photometric stereo leverages variations in illumination conditions to reconstruct surface normals. Display photometric stereo, which employs a conventional monitor as an illumination source, has the potential to overcome…

DiLiGenRT: A Photometric Stereo Dataset with Quantified Roughness and Translucency

2024-01-01 · CVPR 2024 1 · Heng Guo, Jieji Ren, Feishi Wang, Boxin Shi 외

Photometric stereo faces challenges from non-Lambertian reflectance in real-world scenarios. Systematically measuring the reliability of photometric stereo methods in handling such complex reflectance necessitates a …