paper-with-me

홈 › Papers

Deep Learning Methods for Calibrated Photometric Stereo and Beyond

2022-12-16 · Yakun Ju, Kin-Man Lam, Wuyuan Xie, Huiyu Zhou, Junyu Dong, Boxin Shi

Photometric stereo recovers the surface normals of an object from multiple images with varying shading cues, i.e., modeling the relationship between surface orientation and intensity at each pixel. Photometric stereo prevails in superior per-pixel resolution and fine reconstruction details. However, it is a complicated problem because of the non-linear relationship caused by non-Lambertian surface reflectance. Recently, various deep learning methods have shown a powerful ability in the context of photometric stereo against non-Lambertian surfaces. This paper provides a comprehensive review of existing deep learning-based calibrated photometric stereo methods. We first analyze these methods from different perspectives, including input processing, supervision, and network architecture. We summarize the performance of deep learning photometric stereo models on the most widely-used benchmark data set. This demonstrates the advanced performance of deep learning-based photometric stereo methods. Finally, we give suggestions and propose future research trends based on the limitations of existing models.

📄 PDF Abstract BibTeX arXiv:2212.08414

Code (1)

kelvin-ju/survey-dlcps 공식 구현

Tasks

Deep Learning

Similar Papers 제목 키워드 기반

DiLiGenT-Pi: Photometric Stereo for Planar Surfaces with Rich Details - Benchmark Dataset and Beyond

2023-01-01 · ICCV 2023 1 · Feishi Wang, Jieji Ren, Heng Guo, Mingjun Ren 외

Photometric stereo aims to recover detailed surface shapes from images captured under varying illuminations. However, existing real-world datasets primarily focus on evaluating photometric stereo for general non-Lamb…

3D ReconstructionSurface Normal Estimation

A Benchmark Dataset and Evaluation for Non-Lambertian and Uncalibrated Photometric Stereo

2016-06-01 · CVPR 2016 6 · Boxin Shi, Zhe Wu, Zhipeng Mo, Dinglong Duan 외

Recent progress on photometric stereo extends the technique to deal with general materials and unknown illumination conditions. However, due to the lack of suitable benchmark data with ground truth shapes (normals), quan…

What is Learned in Deep Uncalibrated Photometric Stereo?

2020-08-01 · ECCV 2020 8 · Guan-Ying Chen, Michael Waechter, Boxin Shi, Kwan-Yee K. Wong 외

This paper targets at discovering what a deep uncalibrated photometric stereo network learns to resolve the problem’s inherent ambiguity, and designing an effective network architecture based on the new insight to improv…

Lighting EstimationSurface Normal Estimation

Universal Photometric Stereo Network using Global Lighting Contexts

2022-06-06 · CVPR 2022 1 · Satoshi Ikehata

This paper tackles a new photometric stereo task, named universal photometric stereo. Unlike existing tasks that assumed specific physical lighting models; hence, drastically limited their usability, a solution algorithm…

Physics-Free Spectrally Multiplexed Photometric Stereo under Unknown Spectral Composition

2024-10-28 · Satoshi Ikehata, Yuta Asano

In this paper, we present a groundbreaking spectrally multiplexed photometric stereo approach for recovering surface normals of dynamic surfaces without the need for calibrated lighting or sensors, a notable advancement …