paper-with-me

홈 › Papers

Event-based Photometric Stereo via Rotating Illumination and Per-Pixel Learning

2026-03-11 · Hyunwoo Kim, Won-Hoe Kim, Sanghoon Lee, Jianfei Cai, Giljoo Nam, Jae-Sang Hyun arxiv

Photometric stereo is a technique for estimating surface normals using images captured under varying illumination. However, conventional frame-based photometric stereo methods are limited in real-world applications due to their reliance on controlled lighting, and susceptibility to ambient illumination. To address these limitations, we propose an event-based photometric stereo system that leverages an event camera, which is effective in scenarios with continuously varying scene radiance and high dynamic range conditions. Our setup employs a single light source moving along a predefined circular trajectory, eliminating the need for multiple synchronized light sources and enabling a more compact and scalable design. We further introduce a lightweight per-pixel multi-layer neural network that directly predicts surface normals from event signals generated by intensity changes as the light source rotates, without system calibration. Experimental results on benchmark datasets and real-world data collected with our data acquisition system demonstrate the effectiveness of our method, achieving a 7.12\% reduction in mean angular error compared to existing event-based photometric stereo methods. In addition, our method demonstrates robustness in regions with sparse event activity, strong ambient illumination, and scenes affected by specularities.

📄 PDF Abstract BibTeX arXiv:2603.10748

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

LIPIDS: Learning-based Illumination Planning In Discretized (Light) Space for Photometric Stereo

2024-09-01 · Ashish Tiwari, Mihir Sutariya, Shanmuganathan Raman

Photometric stereo is a powerful method for obtaining per-pixel surface normals from differently illuminated images of an object. While several methods address photometric stereo with different image (or light) counts ra…

Event Fusion Photometric Stereo Network

2023-03-01 · Wonjeong Ryoo, Giljoo Nam, Jae-Sang Hyun, Sangpil Kim

We present a novel method to estimate the surface normal of an object in an ambient light environment using RGB and event cameras. Modern photometric stereo methods rely on an RGB camera, mainly in a dark room, to avoid …

Surface Normal Estimation

EventPS: Real-Time Photometric Stereo Using an Event Camera

2024-01-01 · CVPR 2024 1 · Bohan Yu, Jieji Ren, Jin Han, Feishi Wang 외

Photometric stereo is a well-established technique to estimate the surface normal of an object. However the requirement of capturing multiple high dynamic range images under different illumination conditions limits t…

Learning Efficient Photometric Feature Transform for Multi-view Stereo

2021-03-27 · ICCV 2021 10 · Kaizhang Kang, Cihui Xie, Ruisheng Zhu, Xiaohe Ma 외

We present a novel framework to learn to convert the perpixel photometric information at each view into spatially distinctive and view-invariant low-level features, which can be plugged into existing multi-view stereo pi…

3D Reconstruction

ReLeaPS : Reinforcement Learning-based Illumination Planning for Generalized Photometric Stereo

2023-01-01 · ICCV 2023 1 · Jun Hoong Chan, Bohan Yu, Heng Guo, Jieji Ren 외

Illumination planning in photometric stereo aims to find a balance between tween surface normal estimation accuracy and image capturing efficiency by selecting optimal light configurations. It depends on factors such…

reinforcement-learningReinforcement LearningSurface Normal Estimation