Papers Inverse Rendering
“Inverse Rendering” 태그가 달린 논문 344편 · 필터 해제
RelightFormer: Feed-forward Generative Transformer for Multiview Object Relighting
Image relighting is traditionally tackled via complex inverse rendering pipelines, which suffer from ill-posed optimization, or single-image generative models that ignore crucial multi-view cues necessary for understandi…
Zero-shot GeneralizationInverse RenderingImage RelightingTransNormal-2: Geometry-Grounded Rectified Flow with Edge-Aware Decoding for Precise Normal Estimation
Diffusion-based models enable monocular geometry estimation, yet their pixel-space precision is limited by a shared, under-studied error source: VAE reconstruction degradation. The 8x spatial compression in the VAE encod…
Inverse RenderingRGBX-Next: Towards Realistic Generative Rendering from G-Buffers
Diffusion models have achieved impressive results in image, video, and streaming generation. However, compared to traditional 3D rendering, they still lack precise control over the generated output. We believe a viable p…
Inverse RenderingDynamic Inverse Rendering for Enhanced Material-Lighting Decomposition
Decomposing outgoing surface radiance into material and illumination during inverse rendering is essential for applications such as relighting and augmented reality, yet it is severely ill-posed since multiple combinatio…
Inverse RenderingObject TrackingLightCrafter: PBR-Conditioned Video Diffusion Refinement for Controllable and Consistent Relighting
Video relighting requires balancing long-form temporal consistency with a physically grounded understanding of light transport, which depends on accurate estimation of intrinsic scene properties such as materials, geomet…
Inverse RenderingVideo GenerationInvSplat: Inverse Feed-Forward Scene Splatting
Inverse rendering aims to recover both 3D geometry and physically meaningful material properties from images, enabling applications such as relighting and novel view synthesis. Optimization-based methods achieve high fid…
Multi-View 3D ReconstructionNovel View SynthesisInverse RenderingDiffusion-Based Material Regularization for Physics-Based Inverse Rendering
Reconstructing physics-based 3D assets -- geometry, materials, and illumination -- from multi-view images is a core problem in computer graphics and vision, and a prerequisite for realistic relighting and editing. Physic…
Inverse RenderingDR-GS: Physically-Based Deformable and Relightable 2D Gaussians
Gaussian splatting (GS) has garnered significant attention in VR/AR and digital content creation due to its explicit parameterization and efficient rendering capabilities. However, existing GS-based methods for deformabl…
Inverse RenderingAEGIR: Modeling Area Emitters for Indoor Inverse Rendering using Gaussian Splatting
Inverse rendering requires separating illumination from surface materials, which is highly ambiguous due to their tight coupling in observed images. While Gaussian Splatting is efficient for novel view synthesis, existin…
Novel View SynthesisInverse RenderingExtracting Neural Materials from Multi-view Images
Neural materials can represent complex specular reflections and scattering effects in a compact, universal basis. However, acquiring and authoring such materials remains challenging. We present NeuMatEx, a differentiable…
Inverse RenderingOSOG: A Differentiable, Physics-Informed Synthetic Data Engine for Micro-Optical Environments
Deep learning in computational microscopy is severely constrained by the scarcity of densely annotated datasets. While synthetic data generation has bridged this gap in macroscopic computer vision, traditional graphics e…
Synthetic Data GenerationInverse RenderingObject DetectionBRDFusion: Physics Meets Generation for Urban Scene Inverse Rendering
Inverse rendering of urban scenes from captured videos enables numerous applications, including content creation and autonomous driving simulation. Physically-based rendering methods follow and control lighting physics, …
Autonomous DrivingInverse RenderingTRON: Tracing Rays to Orchestrate a Neural Renderer for 3D Gaussian Reconstructions
We introduce TRON, a rendering framework that combines 3D Gaussian ray tracing with neural rendering to enable realistic and controllable rendering of real-world 3D scenes under novel lighting, dynamic object motion, obj…
Inverse RenderingAmbient-robust Inverse Rendering using Active RGB-NIR Imaging
Inverse rendering aims to reconstruct geometry and reflectance of objects from images. Despite recent progress, existing methods often produces inaccurate reconstructions that are sensitive to ambient illumination condit…
Inverse RenderingEgoRelight: Egocentric Human Capture and Illumination Recovery for Relightable and Photoreal Avatar Rendering
Mixed Reality (MR) headsets promise a future of immersive telepresence where virtual humans blend indistinguishably into real or virtual surroundings. Achieving this vision requires a method for capturing a user's motion…
Inverse RenderingSnapshot Polarimetric Display Inverse Rendering
Inverse rendering remains a core challenge in graphics and vision, especially in the snapshot configurations required for lightweight desktop workflows, where the per-frame information budget is highly constrained. Previ…
Inverse RenderingHuman face perception reflects inverse-generative and naturalistic discriminative objectives
The perceptual representations supporting our ability to recognize faces remain a computational mystery. Deep neural networks offer mechanistic hypotheses for human face perception, but theoretically distinct models ofte…
Face IdentificationInverse RenderingRelightable Gaussian Splatting for Virtual Production Using Image-Based Illumination
Virtual production (VP) use LED walls to provide both background imagery and image-based lighting. While this enables on-set compositing, it couples lighting to background and scene appearance, limiting flexibility for d…
Inverse Rendering3D ReconstructionImage EditingLearning a Delighting Prior for Facial Appearance Capture in the Wild
High-quality facial appearance capture has traditionally required costly studio recording. Recent works consider an in-the-wild smartphone-based setup; however, their model-based inverse rendering paradigm struggles with…
Inverse Rendering3DSS: 3D Surface Splatting for Inverse Rendering
We present 3D Surface Splatting (3DSS), the first differentiable surface splatting renderer for physically-based inverse rendering from multi-view images. Our central insight is that the surface separation problem at the…
Inverse Rendering