paper-with-me

홈 › Papers

EMLight: Lighting Estimation via Spherical Distribution Approximation

2020-12-21 · Fangneng Zhan, Changgong Zhang, Yingchen Yu, Yuan Chang, Shijian Lu, Feiying Ma, Xuansong Xie

Illumination estimation from a single image is critical in 3D rendering and it has been investigated extensively in the computer vision and computer graphic research community. On the other hand, existing works estimate illumination by either regressing light parameters or generating illumination maps that are often hard to optimize or tend to produce inaccurate predictions. We propose Earth Mover Light (EMLight), an illumination estimation framework that leverages a regression network and a neural projector for accurate illumination estimation. We decompose the illumination map into spherical light distribution, light intensity and the ambient term, and define the illumination estimation as a parameter regression task for the three illumination components. Motivated by the Earth Mover distance, we design a novel spherical mover's loss that guides to regress light distribution parameters accurately by taking advantage of the subtleties of spherical distribution. Under the guidance of the predicted spherical distribution, light intensity and ambient term, the neural projector synthesizes panoramic illumination maps with realistic light frequency. Extensive experiments show that EMLight achieves accurate illumination estimation and the generated relighting in 3D object embedding exhibits superior plausibility and fidelity as compared with state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2012.11116

Code (0)

등록된 구현이 없습니다.

Tasks

Lighting Estimationregression

Similar Papers 제목 키워드 기반

Deep Lighting Environment Map Estimation from Spherical Panoramas

2020-05-16 · Vasileios Gkitsas, Nikolaos Zioulis, Federico Alvarez, Dimitrios Zarpalas 외

Estimating a scene's lighting is a very important task when compositing synthetic content within real environments, with applications in mixed reality and post-production. In this work we present a data-driven model that…

Lighting EstimationMixed Reality

PointAR: Efficient Lighting Estimation for Mobile Augmented Reality

2020-03-30 · ECCV 2020 8 · Yiqin Zhao, Tian Guo

We propose an efficient lighting estimation pipeline that is suitable to run on modern mobile devices, with comparable resource complexities to state-of-the-art mobile deep learning models. Our pipeline, PointAR, takes a…

Lighting Estimation

Sparse Needlets for Lighting Estimation with Spherical Transport Loss

2021-06-24 · ICCV 2021 10 · Fangneng Zhan, Changgong Zhang, WenBo Hu, Shijian Lu 외

Accurate lighting estimation is challenging yet critical to many computer vision and computer graphics tasks such as high-dynamic-range (HDR) relighting. Existing approaches model lighting in either frequency domain or s…

Lighting Estimation

Harmonic Decompositions of Convolutional Networks

2020-03-28 · ICML 2020 1 · Meyer Scetbon, Zaid Harchaoui

We present a description of the function space and the smoothness class associated with a convolutional network using the machinery of reproducing kernel Hilbert spaces. We show that the mapping associated with a convolu…

Analytical Expression for Spherically Symmetric Photoacoustic Sources: A Unified General Solution (Theoretical Analysis and Derivation)

2026-01-12 · Shuang Li, Yibing Wang, Yu Zhang, Changhui Li arxiv

Here we present a comprehensive derivation of the analytical expression for the spatiotemporal acoustic pressure generated by photoacoustic sources with spherically symmetric initial pressure distributions. Starting from…