paper-with-me

홈 › Papers

NDJIR: Neural Direct and Joint Inverse Rendering for Geometry, Lights, and Materials of Real Object

2023-02-02 · Kazuki Yoshiyama, Takuya Narihira

The goal of inverse rendering is to decompose geometry, lights, and materials given pose multi-view images. To achieve this goal, we propose neural direct and joint inverse rendering, NDJIR. Different from prior works which relies on some approximations of the rendering equation, NDJIR directly addresses the integrals in the rendering equation and jointly decomposes geometry: signed distance function, lights: environment and implicit lights, materials: base color, roughness, specular reflectance using the powerful and flexible volume rendering framework, voxel grid feature, and Bayesian prior. Our method directly uses the physically-based rendering, so we can seamlessly export an extracted mesh with materials to DCC tools and show material conversion examples. We perform intensive experiments to show that our proposed method can decompose semantically well for real object in photogrammetric setting and what factors contribute towards accurate inverse rendering.

📄 PDF Abstract BibTeX arXiv:2302.00675

Code (1)

sony/ndjir 공식 구현

Tasks

Inverse Rendering

Methods 이 논문이 사용한 방법론

BASE 설명 없음

Similar Papers 제목 키워드 기반

PS-GS: Gaussian Splatting for Multi-View Photometric Stereo

2025-07-24 · Yixiao Chen, Bin Liang, Hanzhi Guo, Yongqing Cheng 외 arxiv

Integrating inverse rendering with multi-view photometric stereo (MVPS) yields more accurate 3D reconstructions than the inverse rendering approaches that rely on fixed environment illumination. However, efficient invers…

Computational EfficiencyInverse Rendering

UniVoxel: Fast Inverse Rendering by Unified Voxelization of Scene Representation

2024-07-28 · Shuang Wu, Songlin Tang, Guangming Lu, Jianzhuang Liu 외

Typical inverse rendering methods focus on learning implicit neural scene representations by modeling the geometry, materials and illumination separately, which entails significant computations for optimization. In this …

Inverse Rendering

Physics-based Indirect Illumination for Inverse Rendering

2022-12-09 · Youming Deng, Xueting Li, Sifei Liu, Ming-Hsuan Yang

We present a physics-based inverse rendering method that learns the illumination, geometry, and materials of a scene from posed multi-view RGB images. To model the illumination of a scene, existing inverse rendering work…

Efficient Neural NetworkInverse RenderingNovel View Synthesis

PS-NeRF: Neural Inverse Rendering for Multi-view Photometric Stereo

2022-07-23 · Wenqi Yang, GuanYing Chen, Chaofeng Chen, Zhenfang Chen 외

Traditional multi-view photometric stereo (MVPS) methods are often composed of multiple disjoint stages, resulting in noticeable accumulated errors. In this paper, we present a neural inverse rendering method for MVPS ba…

Inverse RenderingNeRFNeural Rendering

PANDORA: Polarization-Aided Neural Decomposition Of Radiance

2022-03-25 · Akshat Dave, Yongyi Zhao, Ashok Veeraraghavan

Reconstructing an object's geometry and appearance from multiple images, also known as inverse rendering, is a fundamental problem in computer graphics and vision. Inverse rendering is inherently ill-posed because the ca…

3D geometryInverse RenderingNovel View Synthesis