paper-with-me

홈 › Papers

HIVE: HIerarchical Volume Encoding for Neural Implicit Surface Reconstruction

2024-08-03 · Xiaodong Gu, Weihao Yuan, Heng Li, Zilong Dong, Ping Tan

Neural implicit surface reconstruction has become a new trend in reconstructing a detailed 3D shape from images. In previous methods, however, the 3D scene is only encoded by the MLPs which do not have an explicit 3D structure. To better represent 3D shapes, we introduce a volume encoding to explicitly encode the spatial information. We further design hierarchical volumes to encode the scene structures in multiple scales. The high-resolution volumes capture the high-frequency geometry details since spatially varying features could be learned from different 3D points, while the low-resolution volumes enforce the spatial consistency to keep the shape smooth since adjacent locations possess the same low-resolution feature. In addition, we adopt a sparse structure to reduce the memory consumption at high-resolution volumes, and two regularization terms to enhance results smoothness. This hierarchical volume encoding could be appended to any implicit surface reconstruction method as a plug-and-play module, and can generate a smooth and clean reconstruction with more details. Superior performance is demonstrated in DTU, EPFL, and BlendedMVS datasets with significant improvement on the standard metrics.

📄 PDF Abstract BibTeX arXiv:2408.01677

Code (0)

등록된 구현이 없습니다.

Tasks

Surface Reconstruction

Similar Papers 제목 키워드 기반

OctField: Hierarchical Implicit Functions for 3D Modeling

2021-11-01 · NeurIPS 2021 12 · Jia-Heng Tang, Weikai Chen, Jie Yang, Bo wang 외

Recent advances in localized implicit functions have enabled neural implicit representation to be scalable to large scenes. However, the regular subdivision of 3D space employed by these approaches fails to take into acc…

NeuDA: Neural Deformable Anchor for High-Fidelity Implicit Surface Reconstruction

2023-03-04 · CVPR 2023 1 · Bowen Cai, Jinchi Huang, Rongfei Jia, Chengfei Lv 외

This paper studies implicit surface reconstruction leveraging differentiable ray casting. Previous works such as IDR and NeuS overlook the spatial context in 3D space when predicting and rendering the surface, thereby ma…

Surface ReconstructionVocal Bursts Intensity Prediction

AHIVE: Anatomy-aware Hierarchical Vision Encoding for Interactive Radiology Report Retrieval

2024-01-01 · CVPR 2024 1 · Sixing Yan, William K. Cheung, Ivor W. Tsang, Keith Chiu 외

Automatic radiology report generation using deep learning models has been recently explored and found promising. Neural decoders are commonly used for the report generation where irrelevant and unfaithful contents ar…

AnatomyDiagnosticRetrieval

Human Performance Modeling and Rendering via Neural Animated Mesh

2022-09-18 · Fuqiang Zhao, Yuheng Jiang, Kaixin Yao, Jiakai Zhang 외

We have recently seen tremendous progress in the neural advances for photo-real human modeling and rendering. However, it's still challenging to integrate them into an existing mesh-based pipeline for downstream applicat…

Vox-Fusion++: Voxel-based Neural Implicit Dense Tracking and Mapping with Multi-maps

2024-03-19 · Hongjia Zhai, Hai Li, Xingrui Yang, Gan Huang 외

In this paper, we introduce Vox-Fusion++, a multi-maps-based robust dense tracking and mapping system that seamlessly fuses neural implicit representations with traditional volumetric fusion techniques. Building upon the…