paper-with-me

홈 › Papers

Radiance Surfaces: Optimizing Surface Representations with a 5D Radiance Field Loss

2025-01-27 · Ziyi Zhang, Nicolas Roussel, Thomas Müller, Tizian Zeltner, Merlin Nimier-David, Fabrice Rousselle, Wenzel Jakob

We present a fast and simple technique to convert images into a radiance surface-based scene representation. Building on existing radiance volume reconstruction algorithms, we introduce a subtle yet impactful modification of the loss function requiring changes to only a few lines of code: instead of integrating the radiance field along rays and supervising the resulting images, we project the training images into the scene to directly supervise the spatio-directional radiance field. The primary outcome of this change is the complete removal of alpha blending and ray marching from the image formation model, instead moving these steps into the loss computation. In addition to promoting convergence to surfaces, this formulation assigns explicit semantic meaning to 2D subsets of the radiance field, turning them into well-defined radiance surfaces. We finally extract a level set from this representation, which results in a high-quality radiance surface model. Our method retains much of the speed and quality of the baseline algorithm. For instance, a suitably modified variant of Instant NGP maintains comparable computational efficiency, while achieving an average PSNR that is only 0.1 dB lower. Most importantly, our method generates explicit surfaces in place of an exponential volume, doing so with a level of simplicity not seen in prior work.

📄 PDF Abstract BibTeX arXiv:2501.18627

Code (0)

등록된 구현이 없습니다.

Tasks

Computational EfficiencySurface Reconstruction

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…
SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Generative Occupancy Fields for 3D Surface-Aware Image Synthesis

2021-11-01 · NeurIPS 2021 12 · Xudong Xu, Xingang Pan, Dahua Lin, Bo Dai

The advent of generative radiance fields has significantly promoted the development of 3D-aware image synthesis. The cumulative rendering process in radiance fields makes training these generative models much easier sinc…

3D-Aware Image SynthesisImage GenerationObject

UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstruction

2021-04-20 · ICCV 2021 10 · Michael Oechsle, Songyou Peng, Andreas Geiger

Neural implicit 3D representations have emerged as a powerful paradigm for reconstructing surfaces from multi-view images and synthesizing novel views. Unfortunately, existing methods such as DVR or IDR require accurate …

3D Object ReconstructionNeRFNovel View SynthesisSurface Reconstruction

NeRFrac: Neural Radiance Fields through Refractive Surface

2023-01-01 · ICCV 2023 1 · Yifan Zhan, Shohei Nobuhara, Ko Nishino, Yinqiang Zheng

Neural Radiance Fields (NeRF) is a popular neural expression for novel view synthesis. By querying spatial points and view directions, a multilayer perceptron (MLP) can be trained to output the volume density and rad…

NeRFNovel View Synthesis

Learning Neural Implicit Surfaces with Object-Aware Radiance Fields

2023-01-01 · ICCV 2023 1 · Yiheng Zhang, Zhaofan Qiu, Yingwei Pan, Ting Yao 외

Recent progress on multi-view 3D object reconstruction has featured neural implicit surfaces via learning high-fidelity radiance fields. However, most approaches hinge on the visual hull derived from cost-expensive s…

3D Object ReconstructionObjectObject Reconstruction

RaNeuS: Ray-adaptive Neural Surface Reconstruction

2024-06-14 · Yida Wang, David Joseph Tan, Nassir Navab, Federico Tombari

Our objective is to leverage a differentiable radiance field \eg NeRF to reconstruct detailed 3D surfaces in addition to producing the standard novel view renderings. There have been related methods that perform such tas…

NeRFNovel View SynthesisSurface Reconstruction