Many-Worlds Inverse Rendering
Discontinuous visibility changes remain a major bottleneck when optimizing surfaces within a physically-based inverse renderer. Many previous works have proposed sophisticated algorithms and data structures to sample visibility silhouettes more efficiently. Our work presents another solution: instead of differentiating a tentative surface locally, we differentiate a volumetric perturbation of a surface. We refer this as a many-worlds representation because it models a non-interacting superposition of conflicting explanations (worlds) of the input dataset. Each world is optically isolated from others, leading to a new transport law that distinguishes our method from prior work based on exponential random media. The resulting Monte Carlo algorithm is simpler and more efficient than prior methods. We demonstrate that our method promotes rapid convergence, both in terms of the total iteration count and the cost per iteration.
Code (0)
등록된 구현이 없습니다.
Tasks
Inverse RenderingSimilar Papers 제목 키워드 기반
NeRF as a Non-Distant Environment Emitter in Physics-based Inverse Rendering
Physics-based inverse rendering enables joint optimization of shape, material, and lighting based on captured 2D images. To ensure accurate reconstruction, using a light model that closely resembles the captured environm…
Inverse RenderingNeRFWorld Reconstruction From Inconsistent Views
Video diffusion models generate high-quality and diverse worlds; however, individual frames often lack 3D consistency across the output sequence, which makes the reconstruction of 3D worlds difficult. To this end, we pro…
3D ReconstructionDiffusion Posterior Illumination for Ambiguity-aware Inverse Rendering
Inverse rendering, the process of inferring scene properties from images, is a challenging inverse problem. The task is ill-posed, as many different scene configurations can give rise to the same image. Most existing sol…
DenoisingInverse RenderingConvergence and Recovery Guarantees of Unsupervised Neural Networks for Inverse Problems
Neural networks have become a prominent approach to solve inverse problems in recent years. While a plethora of such methods was developed to solve inverse problems empirically, we are still lacking clear theoretical gua…
Phys3DGS: Physically-based 3D Gaussian Splatting for Inverse Rendering
We propose two novel ideas (adoption of deferred rendering and mesh-based representation) to improve the quality of 3D Gaussian splatting (3DGS) based inverse rendering. We first report a problem incurred by hidden Gauss…
3DGSInverse Rendering