paper-with-me

홈 › Papers

Rethinking Directional Parameterization in Neural Implicit Surface Reconstruction

2024-09-11 · Zijie Jiang, Tianhan Xu, Hiroharu Kato

Multi-view 3D surface reconstruction using neural implicit representations has made notable progress by modeling the geometry and view-dependent radiance fields within a unified framework. However, their effectiveness in reconstructing objects with specular or complex surfaces is typically biased by the directional parameterization used in their view-dependent radiance network. {\it Viewing direction} and {\it reflection direction} are the two most commonly used directional parameterizations but have their own limitations. Typically, utilizing the viewing direction usually struggles to correctly decouple the geometry and appearance of objects with highly specular surfaces, while using the reflection direction tends to yield overly smooth reconstructions for concave or complex structures. In this paper, we analyze their failed cases in detail and propose a novel hybrid directional parameterization to address their limitations in a unified form. Extensive experiments demonstrate the proposed hybrid directional parameterization consistently delivered satisfactory results in reconstructing objects with a wide variety of materials, geometry and appearance, whereas using other directional parameterizations faces challenges in reconstructing certain objects. Moreover, the proposed hybrid directional parameterization is nearly parameter-free and can be effortlessly applied in any existing neural surface reconstruction method.

📄 PDF Abstract BibTeX arXiv:2409.06923

Code (0)

등록된 구현이 없습니다.

Tasks

Surface Reconstruction

Similar Papers 제목 키워드 기반

NeRS: Neural Reflectance Surfaces for Sparse-view 3D Reconstruction in the Wild

2021-10-14 · NeurIPS 2021 12 · Jason Y. Zhang, Gengshan Yang, Shubham Tulsiani, Deva Ramanan

Recent history has seen a tremendous growth of work exploring implicit representations of geometry and radiance, popularized through Neural Radiance Fields (NeRF). Such works are fundamentally based on a (implicit) volum…

3D ReconstructionNeRFNeural Rendering

Parameterization-driven Neural Surface Reconstruction for Object-oriented Editing in Neural Rendering

2023-10-09 · Baixin Xu, Jiangbei Hu, Fei Hou, Kwan-Yee Lin 외

The advancements in neural rendering have increased the need for techniques that enable intuitive editing of 3D objects represented as neural implicit surfaces. This paper introduces a novel neural algorithm for paramete…

3D geometryNeural RenderingSurface Reconstruction

Learning Surface Parameterization for Document Image Unwarping

2021-09-29 · Sagnik Das, Ke Ma, Zhixin Shu, Dimitris Samaras

In this paper, we present a novel approach to learn texture mapping for a 3D surface and apply it to document image unwarping. We propose an efficient method to learn surface parameterization by learning a continuous bij…

3D Scene Reconstruction

DeepMesh: Differentiable Iso-Surface Extraction

2021-06-20 · Benoit Guillard, Edoardo Remelli, Artem Lukoianov, Stephan R. Richter 외

Geometric Deep Learning has recently made striking progress with the advent of continuous deep implicit fields. They allow for detailed modeling of watertight surfaces of arbitrary topology while not relying on a 3D Eucl…

3D ReconstructionSingle-View 3D Reconstruction

MeshSDF: Differentiable Iso-Surface Extraction

2020-06-06 · NeurIPS 2020 12 · Edoardo Remelli, Artem Lukoianov, Stephan R. Richter, Benoît Guillard 외

Geometric Deep Learning has recently made striking progress with the advent of continuous Deep Implicit Fields. They allow for detailed modeling of watertight surfaces of arbitrary topology while not relying on a 3D Eucl…