paper-with-me

Papers

3D Density-Gradient based Edge Detection on Neural Radiance Fields (NeRFs) for Geometric Reconstruction

2023-09-26 · Miriam Jäger, Boris Jutzi

Generating geometric 3D reconstructions from Neural Radiance Fields (NeRFs) is of great interest. However, accurate and complete reconstructions based on the density values are challenging. The network output depends on input data, NeRF network configuration and hyperparameter. As a result, the direct usage of density values, e.g. via filtering with global density thresholds, usually requires empirical investigations. Under the assumption that the density increases from non-object to object area, the utilization of density gradients from relative values is evident. As the density represents a position-dependent parameter it can be handled anisotropically, therefore processing of the voxelized 3D density field is justified. In this regard, we address geometric 3D reconstructions based on density gradients, whereas the gradients result from 3D edge detection filters of the first and second derivatives, namely Sobel, Canny and Laplacian of Gaussian. The gradients rely on relative neighboring density values in all directions, thus are independent from absolute magnitudes. Consequently, gradient filters are able to extract edges along a wide density range, almost independent from assumptions and empirical investigations. Our approach demonstrates the capability to achieve geometric 3D reconstructions with high geometric accuracy on object surfaces and remarkable object completeness. Notably, Canny filter effectively eliminates gaps, delivers a uniform point density, and strikes a favorable balance between correctness and completeness across the scenes.

📄 PDF Abstract BibTeX arXiv:2309.14800

Code (0)

등록된 구현이 없습니다.

Tasks

Edge DetectionNeRFObject

Similar Papers 제목 키워드 기반

Reducing Shape-Radiance Ambiguity in Radiance Fields with a Closed-Form Color Estimation Method

2023-12-20 · NeurIPS 2023 11 · Qihang Fang, Yafei Song, Keqiang Li, Liefeng Bo

Neural radiance field (NeRF) enables the synthesis of cutting-edge realistic novel view images of a 3D scene. It includes density and color fields to model the shape and radiance of a scene, respectively. Supervised by t…

FormNeRF

DiffusioNeRF: Regularizing Neural Radiance Fields with Denoising Diffusion Models

2023-02-23 · CVPR 2023 1 · Jamie Wynn, Daniyar Turmukhambetov

Under good conditions, Neural Radiance Fields (NeRFs) have shown impressive results on novel view synthesis tasks. NeRFs learn a scene's color and density fields by minimizing the photometric discrepancy between training…

DenoisingNeRFNovel View Synthesis

Differentiable Rendering with Reparameterized Volume Sampling

2023-02-21 · Nikita Morozov, Denis Rakitin, Oleg Desheulin, Dmitry Vetrov 외

In view synthesis, a neural radiance field approximates underlying density and radiance fields based on a sparse set of scene pictures. To generate a pixel of a novel view, it marches a ray through the pixel and computes…

NeRFNovel View Synthesis

Neural Density-Distance Fields

2022-07-29 · Itsuki Ueda, Yoshihiro Fukuhara, Hirokatsu Kataoka, Hiroaki Aizawa 외

The success of neural fields for 3D vision tasks is now indisputable. Following this trend, several methods aiming for visual localization (e.g., SLAM) have been proposed to estimate distance or density fields using neur…

NeRFNovel View SynthesisVisual Localization

Colorizing Monochromatic Radiance Fields

2024-02-19 · Yean Cheng, Renjie Wan, Shuchen Weng, Chengxuan Zhu 외

Though Neural Radiance Fields (NeRF) can produce colorful 3D representations of the world by using a set of 2D images, such ability becomes non-existent when only monochromatic images are provided. Since color is necessa…

ColorizationImage ColorizationNeRF