paper-with-me

Papers

VolRecon: Volume Rendering of Signed Ray Distance Functions for Generalizable Multi-View Reconstruction

2022-12-15 · CVPR 2023 1 · Yufan Ren, Fangjinhua Wang, Tong Zhang, Marc Pollefeys, Sabine Süsstrunk

The success of the Neural Radiance Fields (NeRF) in novel view synthesis has inspired researchers to propose neural implicit scene reconstruction. However, most existing neural implicit reconstruction methods optimize per-scene parameters and therefore lack generalizability to new scenes. We introduce VolRecon, a novel generalizable implicit reconstruction method with Signed Ray Distance Function (SRDF). To reconstruct the scene with fine details and little noise, VolRecon combines projection features aggregated from multi-view features, and volume features interpolated from a coarse global feature volume. Using a ray transformer, we compute SRDF values of sampled points on a ray and then render color and depth. On DTU dataset, VolRecon outperforms SparseNeuS by about 30% in sparse view reconstruction and achieves comparable accuracy as MVSNet in full view reconstruction. Furthermore, our approach exhibits good generalization performance on the large-scale ETH3D benchmark.

📄 PDF Abstract BibTeX arXiv:2212.08067

Code (1)

ivrl/volrecon 공식 구현 pytorch

Tasks

NeRFNovel View Synthesis

Similar Papers 제목 키워드 기반

Sensing Surface Patches in Volume Rendering for Inferring Signed Distance Functions

2024-12-21 · Sijia Jiang, Tong Wu, Jing Hua, Zhizhong Han

It is vital to recover 3D geometry from multi-view RGB images in many 3D computer vision tasks. The latest methods infer the geometry represented as a signed distance field by minimizing the rendering error on the field …

3D geometry

Learning Unsigned Distance Functions from Multi-view Images with Volume Rendering Priors

2024-07-23 · Wenyuan Zhang, Kanle Shi, Yu-Shen Liu, Zhizhong Han

Unsigned distance functions (UDFs) have been a vital representation for open surfaces. With different differentiable renderers, current methods are able to train neural networks to infer a UDF by minimizing the rendering…

Sur2f: A Hybrid Representation for High-Quality and Efficient Surface Reconstruction from Multi-view Images

2024-01-08 · Zhangjin Huang, Zhihao Liang, Haojie Zhang, Yangkai Lin 외

Multi-view surface reconstruction is an ill-posed, inverse problem in 3D vision research. It involves modeling the geometry and appearance with appropriate surface representations. Most of the existing methods rely eithe…

Surface Reconstruction

NeAT: Learning Neural Implicit Surfaces with Arbitrary Topologies from Multi-view Images

2023-03-21 · CVPR 2023 1 · Xiaoxu Meng, Weikai Chen, Bo Yang

Recent progress in neural implicit functions has set new state-of-the-art in reconstructing high-fidelity 3D shapes from a collection of images. However, these approaches are limited to closed surfaces as they require th…

Neural RenderingSurface Reconstruction

NeuralUDF: Learning Unsigned Distance Fields for Multi-view Reconstruction of Surfaces with Arbitrary Topologies

2022-11-25 · CVPR 2023 1 · Xiaoxiao Long, Cheng Lin, Lingjie Liu, YuAn Liu 외

We present a novel method, called NeuralUDF, for reconstructing surfaces with arbitrary topologies from 2D images via volume rendering. Recent advances in neural rendering based reconstruction have achieved compelling re…

Neural Rendering