All-Weather Deep Outdoor Lighting Estimation
We present a neural network that predicts HDR outdoor illumination from a single LDR image. At the heart of our work is a method to accurately learn HDR lighting from LDR panoramas under any weather condition. We achieve this by training another CNN (on a combination of synthetic and real images) to take as input an LDR panorama, and regress the parameters of the Lalonde-Matthews outdoor illumination model. This model is trained such that it a) reconstructs the appearance of the sky, and b) renders the appearance of objects lit by this illumination. We use this network to label a large-scale dataset of LDR panoramas with lighting parameters and use them to train our single image outdoor lighting estimation network. We demonstrate, via extensive experiments, that both our panorama and single image networks outperform the state of the art, and unlike prior work, are able to handle weather conditions ranging from fully sunny to overcast skies.
Code (0)
등록된 구현이 없습니다.
Tasks
AllLighting EstimationSimilar Papers 제목 키워드 기반
Single Day Outdoor Photometric Stereo
Photometric Stereo (PS) under outdoor illumination remains a challenging, ill-posed problem due to insufficient variability in illumination. Months-long capture sessions are typically used in this setup, with little succ…
Spatially-Varying Outdoor Lighting Estimation from Intrinsics
We present SOLID-Net, a neural network for spatially-varying outdoor lighting estimation from a single outdoor image for any 2D pixel location. Previous work has used a unified sky environment map to represent outdoor li…
Lighting EstimationNeural Light Field Estimation for Street Scenes with Differentiable Virtual Object Insertion
We consider the challenging problem of outdoor lighting estimation for the goal of photorealistic virtual object insertion into photographs. Existing works on outdoor lighting estimation typically simplify the scene ligh…
Autonomous DrivingLighting EstimationObjectHierarchical Disentangled Representation Learning for Outdoor Illumination Estimation and Editing
Data-driven sky models have gained much attention in outdoor illumination prediction recently, showing superior performance against analytical models. However, naively compressing an outdoor panorama into a low-dimen…
Representation LearningComplementary Intrinsics From Neural Radiance Fields and CNNs for Outdoor Scene Relighting
Relighting an outdoor scene is challenging due to the diverse illuminations and salient cast shadows. Intrinsic image decomposition on outdoor photo collections could partly solve this problem by weakly supervised la…
Intrinsic Image Decomposition