paper-with-me

홈 › Papers

Neural Architecture Search for Efficient Uncalibrated Deep Photometric Stereo

2021-10-11 · Francesco Sarno, Suryansh Kumar, Berk Kaya, Zhiwu Huang, Vittorio Ferrari, Luc van Gool

We present an automated machine learning approach for uncalibrated photometric stereo (PS). Our work aims at discovering lightweight and computationally efficient PS neural networks with excellent surface normal accuracy. Unlike previous uncalibrated deep PS networks, which are handcrafted and carefully tuned, we leverage differentiable neural architecture search (NAS) strategy to find uncalibrated PS architecture automatically. We begin by defining a discrete search space for a light calibration network and a normal estimation network, respectively. We then perform a continuous relaxation of this search space and present a gradient-based optimization strategy to find an efficient light calibration and normal estimation network. Directly applying the NAS methodology to uncalibrated PS is not straightforward as certain task-specific constraints must be satisfied, which we impose explicitly. Moreover, we search for and train the two networks separately to account for the Generalized Bas-Relief (GBR) ambiguity. Extensive experiments on the DiLiGenT dataset show that the automatically searched neural architectures performance compares favorably with the state-of-the-art uncalibrated PS methods while having a lower memory footprint.

📄 PDF Abstract BibTeX arXiv:2110.05621

Code (0)

등록된 구현이 없습니다.

Tasks

Neural Architecture Search

Similar Papers 제목 키워드 기반

Self-calibrating Deep Photometric Stereo Networks

2019-03-18 · CVPR 2019 6 · Guan-Ying Chen, Kai Han, Boxin Shi, Yasuyuki Matsushita 외

This paper proposes an uncalibrated photometric stereo method for non-Lambertian scenes based on deep learning. Unlike previous approaches that heavily rely on assumptions of specific reflectances and light source distri…

Deep Learning

What is Learned in Deep Uncalibrated Photometric Stereo?

2020-08-01 · ECCV 2020 8 · Guan-Ying Chen, Michael Waechter, Boxin Shi, Kwan-Yee K. Wong 외

This paper targets at discovering what a deep uncalibrated photometric stereo network learns to resolve the problem’s inherent ambiguity, and designing an effective network architecture based on the new insight to improv…

Lighting EstimationSurface Normal Estimation

Uncalibrated Photometric Stereo by Stepwise Optimization Using Principal Components of Isotropic BRDFs

2016-06-01 · CVPR 2016 6 · Keisuke Midorikawa, Toshihiko Yamasaki, Kiyoharu Aizawa

The uncalibrated photometric stereo problem for non-Lambertian surfaces is challenging because of the large number of unknowns and its ill-posed nature stemming from unknown reflectance functions. We propose a model tha…

A Benchmark Dataset and Evaluation for Non-Lambertian and Uncalibrated Photometric Stereo

2016-06-01 · CVPR 2016 6 · Boxin Shi, Zhe Wu, Zhipeng Mo, Dinglong Duan 외

Recent progress on photometric stereo extends the technique to deal with general materials and unknown illumination conditions. However, due to the lack of suitable benchmark data with ground truth shapes (normals), quan…

A New Perspective on Uncalibrated Photometric Stereo

2013-06-01 · CVPR 2013 6 · Thoma Papadhimitri, Paolo Favaro

We investigate the problem of reconstructing normals, albedo and lights of Lambertian surfaces in uncalibrated photometric stereo under the perspective projection model. Our analysis is based on establishing the integrab…