paper-with-me

홈 › Papers

All-Weather Deep Outdoor Lighting Estimation

2019-06-12 · CVPR 2019 6 · Jinsong Zhang, Kalyan Sunkavalli, Yannick Hold-Geoffroy, Sunil Hadap, Jonathan Eisenmann, Jean-François Lalonde

We present a neural network that predicts HDR outdoor illumination from a single LDR image. At the heart of our work is a method to accurately learn HDR lighting from LDR panoramas under any weather condition. We achieve this by training another CNN (on a combination of synthetic and real images) to take as input an LDR panorama, and regress the parameters of the Lalonde-Matthews outdoor illumination model. This model is trained such that it a) reconstructs the appearance of the sky, and b) renders the appearance of objects lit by this illumination. We use this network to label a large-scale dataset of LDR panoramas with lighting parameters and use them to train our single image outdoor lighting estimation network. We demonstrate, via extensive experiments, that both our panorama and single image networks outperform the state of the art, and unlike prior work, are able to handle weather conditions ranging from fully sunny to overcast skies.

📄 PDF Abstract BibTeX arXiv:1906.04909

Code (0)

등록된 구현이 없습니다.

Tasks

AllLighting Estimation

Similar Papers 제목 키워드 기반

Single Day Outdoor Photometric Stereo

2018-03-28 · Yannick Hold-Geoffroy, Paulo F. U. Gotardo, Jean-François Lalonde

Photometric Stereo (PS) under outdoor illumination remains a challenging, ill-posed problem due to insufficient variability in illumination. Months-long capture sessions are typically used in this setup, with little succ…

Spatially-Varying Outdoor Lighting Estimation from Intrinsics

2021-04-09 · CVPR 2021 1 · Yongjie Zhu, yinda zhang, Si Li, Boxin Shi

We present SOLID-Net, a neural network for spatially-varying outdoor lighting estimation from a single outdoor image for any 2D pixel location. Previous work has used a unified sky environment map to represent outdoor li…

Lighting Estimation

Neural Light Field Estimation for Street Scenes with Differentiable Virtual Object Insertion

2022-08-19 · Zian Wang, Wenzheng Chen, David Acuna, Jan Kautz 외

We consider the challenging problem of outdoor lighting estimation for the goal of photorealistic virtual object insertion into photographs. Existing works on outdoor lighting estimation typically simplify the scene ligh…

Autonomous DrivingLighting EstimationObject

Hierarchical Disentangled Representation Learning for Outdoor Illumination Estimation and Editing

2021-01-01 · ICCV 2021 10 · Piaopiao Yu, Jie Guo, Fan Huang, Cheng Zhou 외

Data-driven sky models have gained much attention in outdoor illumination prediction recently, showing superior performance against analytical models. However, naively compressing an outdoor panorama into a low-dimen…

Representation Learning

Complementary Intrinsics From Neural Radiance Fields and CNNs for Outdoor Scene Relighting

2023-01-01 · CVPR 2023 1 · Siqi Yang, Xuanning Cui, Yongjie Zhu, Jiajun Tang 외

Relighting an outdoor scene is challenging due to the diverse illuminations and salient cast shadows. Intrinsic image decomposition on outdoor photo collections could partly solve this problem by weakly supervised la…

Intrinsic Image Decomposition