paper-with-me

Papers

Spatially-Varying Outdoor Lighting Estimation from Intrinsics

2021-04-09 · CVPR 2021 1 · Yongjie Zhu, yinda zhang, Si Li, Boxin Shi

We present SOLID-Net, a neural network for spatially-varying outdoor lighting estimation from a single outdoor image for any 2D pixel location. Previous work has used a unified sky environment map to represent outdoor lighting. Instead, we generate spatially-varying local lighting environment maps by combining global sky environment map with warped image information according to geometric information estimated from intrinsics. As no outdoor dataset with image and local lighting ground truth is readily available, we introduce the SOLID-Img dataset with physically-based rendered images and their corresponding intrinsic and lighting information. We train a deep neural network to regress intrinsic cues with physically-based constraints and use them to conduct global and local lightings estimation. Experiments on both synthetic and real datasets show that SOLID-Net significantly outperforms previous methods.

📄 PDF Abstract BibTeX arXiv:2104.04160

Code (0)

등록된 구현이 없습니다.

Tasks

Lighting Estimation

Similar Papers 제목 키워드 기반

Neural Light Field Estimation for Street Scenes with Differentiable Virtual Object Insertion

2022-08-19 · Zian Wang, Wenzheng Chen, David Acuna, Jan Kautz 외

We consider the challenging problem of outdoor lighting estimation for the goal of photorealistic virtual object insertion into photographs. Existing works on outdoor lighting estimation typically simplify the scene ligh…

Autonomous DrivingLighting EstimationObject

Complementary Intrinsics From Neural Radiance Fields and CNNs for Outdoor Scene Relighting

2023-01-01 · CVPR 2023 1 · Siqi Yang, Xuanning Cui, Yongjie Zhu, Jiajun Tang 외

Relighting an outdoor scene is challenging due to the diverse illuminations and salient cast shadows. Intrinsic image decomposition on outdoor photo collections could partly solve this problem by weakly supervised la…

Intrinsic Image Decomposition

MAIR: Multi-view Attention Inverse Rendering with 3D Spatially-Varying Lighting Estimation

2023-03-22 · CVPR 2023 1 · Junyong Choi, SeokYeong Lee, Haesol Park, Seung-Won Jung 외

We propose a scene-level inverse rendering framework that uses multi-view images to decompose the scene into geometry, a SVBRDF, and 3D spatially-varying lighting. Because multi-view images provide a variety of informati…

Inverse RenderingLighting Estimation

Zero-Shot Metric Depth with a Field-of-View Conditioned Diffusion Model

2023-12-20 · Saurabh Saxena, Junhwa Hur, Charles Herrmann, Deqing Sun 외

While methods for monocular depth estimation have made significant strides on standard benchmarks, zero-shot metric depth estimation remains unsolved. Challenges include the joint modeling of indoor and outdoor scenes, w…

DenoisingDepth EstimationMonocular Depth Estimation

Fast Spatially-Varying Indoor Lighting Estimation

2019-06-10 · CVPR 2019 6 · Mathieu Garon, Kalyan Sunkavalli, Sunil Hadap, Nathan Carr 외

We propose a real-time method to estimate spatiallyvarying indoor lighting from a single RGB image. Given an image and a 2D location in that image, our CNN estimates a 5th order spherical harmonic representation of the l…

Lighting EstimationPosition