paper-with-me

Papers

Robust Point Light Source Estimation Using Differentiable Rendering

2018-12-12 · Grégoire Nieto, Salma Jiddi, Philippe Robert

Illumination estimation is often used in mixed reality to re-render a scene from another point of view, to change the color/texture of an object, or to insert a virtual object consistently lit into a real video or photograph. Specifically, the estimation of a point light source is required for the shadows cast by the inserted object to be consistent with the real scene. We tackle the problem of illumination retrieval given an RGBD image of the scene as an inverse problem: we aim to find the illumination that minimizes the photometric error between the rendered image and the observation. In particular we propose a novel differentiable renderer based on the Blinn-Phong model with cast shadows. We compare our differentiable renderer to state-of-the-art methods and demonstrate its robustness to an incorrect reflectance estimation.

📄 PDF Abstract BibTeX arXiv:1812.04857

Code (0)

등록된 구현이 없습니다.

Tasks

Mixed RealityObjectOutdoor Light Source EstimationRetrieval

Similar Papers 제목 키워드 기반

Relightable 3D Gaussians: Realistic Point Cloud Relighting with BRDF Decomposition and Ray Tracing

2023-11-27 · Jian Gao, Chun Gu, Youtian Lin, Zhihao LI 외

In this paper, we present a novel differentiable point-based rendering framework to achieve photo-realistic relighting. To make the reconstructed scene relightable, we enhance vanilla 3D Gaussians by associating extra pr…

BRDF estimationLighting EstimationNovel View Synthesis

Pointersect: Neural Rendering with Cloud-Ray Intersection

2023-04-24 · CVPR 2023 1 · Jen-Hao Rick Chang, Wei-Yu Chen, Anurag Ranjan, Kwang Moo Yi 외

We propose a novel method that renders point clouds as if they are surfaces. The proposed method is differentiable and requires no scene-specific optimization. This unique capability enables, out-of-the-box, surface norm…

Inverse RenderingNeural RenderingSurface Normal EstimationSurface Reconstruction

LightOctree: Lightweight 3D Spatially-Coherent Indoor Lighting Estimation

2024-04-05 · CVPR 2024 1 · Xuecan Wang, Shibang Xiao, Xiaohui Liang

We present a lightweight solution for estimating spatially-coherent indoor lighting from a single RGB image. Previous methods for estimating illumination using volumetric representations have overlooked the sparse distri…

Lighting Estimation

Physics-based Indirect Illumination for Inverse Rendering

2022-12-09 · Youming Deng, Xueting Li, Sifei Liu, Ming-Hsuan Yang

We present a physics-based inverse rendering method that learns the illumination, geometry, and materials of a scene from posed multi-view RGB images. To model the illumination of a scene, existing inverse rendering work…

Efficient Neural NetworkInverse RenderingNovel View Synthesis

Differentiable Rendering for Pose Estimation in Proximity Operations

2022-12-24 · Ramchander Rao Bhaskara, Roshan Thomas Eapen, Manoranjan Majji

Differentiable rendering aims to compute the derivative of the image rendering function with respect to the rendering parameters. This paper presents a novel algorithm for 6-DoF pose estimation through gradient-based opt…

Pose Estimation