paper-with-me

Papers

Physically-Plausible Illumination Distribution Estimation

2023-01-01 · ICCV 2023 1 · Egor Ershov, Vasily Tesalin, Ivan Ermakov, Michael S. Brown

A camera's auto-white-balance (AWB) module operates under the assumption that there is a single dominant illumination in a captured scene. AWB methods estimate an image's dominant illumination and use it as the target "white point" for correction. However, in natural scenes, there are often many light sources present. We performed a user study that revealed that non-dominant illuminations often produce visually pleasing white-balanced images and, in some cases, are even preferred over the dominant illumination. Motivated by this observation, we revisit AWB to predict a distribution of plausible illuminations for use in white balance. As part of this effort, we extend the Cube++ illumination estimation dataset to provide ground truth illumination distributions per image. Using this new ground truth data, we describe how to train a lightweight neural network method to predict the scene's illumination distribution. We describe how our idea can be used with existing image formats by embedding the estimated distribution in the RAW image to enable users to generate visually plausible white-balance images.

📄 PDF Abstract BibTeX

Code (1)

createcolor/ide 공식 구현 pytorch

Similar Papers 제목 키워드 기반

Deep Outdoor Illumination Estimation

2016-11-19 · CVPR 2017 7 · Yannick Hold-Geoffroy, Kalyan Sunkavalli, Sunil Hadap, Emiliano Gambaretto 외

We present a CNN-based technique to estimate high-dynamic range outdoor illumination from a single low dynamic range image. To train the CNN, we leverage a large dataset of outdoor panoramas. We fit a low-dimensional phy…

Outdoor Light Source Estimation

Deep Sky Modeling for Single Image Outdoor Lighting Estimation

2019-05-10 · CVPR 2019 6 · Yannick Hold-Geoffroy, Akshaya Athawale, Jean-François Lalonde

We propose a data-driven learned sky model, which we use for outdoor lighting estimation from a single image. As no large-scale dataset of images and their corresponding ground truth illumination is readily available, we…

DiversityLighting Estimation

Physics-driven Fire Modeling from Multi-view Images

2018-04-14 · Garoe Dorta, Luca Benedetti, Dmitry Kit, Yong-Liang Yang

Fire effects are widely used in various computer graphics applications such as visual effects and video games. Modeling the shape and appearance of fire phenomenon is challenging as the underlying effects are driven by c…

Physical Simulationsvalid

NePF: Neural Photon Field for Single-Stage Inverse Rendering

2023-11-20 · Tuen-Yue Tsui, Qin Zou

We present a novel single-stage framework, Neural Photon Field (NePF), to address the ill-posed inverse rendering from multi-view images. Contrary to previous methods that recover the geometry, material, and illumination…

Inverse Rendering

Objects As Cameras: Estimating High-Frequency Illumination From Shadows

2021-01-01 · ICCV 2021 10 · Tristan Swedish, Connor Henley, Ramesh Raskar

We recover high-frequency information encoded in the shadows cast by an object to estimate a hemispherical photograph from the viewpoint of the object, effectively turning objects into cameras. Estimating environment…

HallucinationObjectparameter estimationVocal Bursts Intensity Prediction