paper-with-me

홈 › Papers

Online 3D Scene Reconstruction Using Neural Object Priors

2025-03-24 · Thomas Chabal, ShiZhe Chen, Jean Ponce, Cordelia Schmid

This paper addresses the problem of reconstructing a scene online at the level of objects given an RGB-D video sequence. While current object-aware neural implicit representations hold promise, they are limited in online reconstruction efficiency and shape completion. Our main contributions to alleviate the above limitations are twofold. First, we propose a feature grid interpolation mechanism to continuously update grid-based object-centric neural implicit representations as new object parts are revealed. Second, we construct an object library with previously mapped objects in advance and leverage the corresponding shape priors to initialize geometric object models in new videos, subsequently completing them with novel views as well as synthesized past views to avoid losing original object details. Extensive experiments on synthetic environments from the Replica dataset, real-world ScanNet sequences and videos captured in our laboratory demonstrate that our approach outperforms state-of-the-art neural implicit models for this task in terms of reconstruction accuracy and completeness.

📄 PDF Abstract BibTeX arXiv:2503.18897

Code (0)

등록된 구현이 없습니다.

Tasks

3D Scene ReconstructionObject

Methods 이 논문이 사용한 방법론

Library 설명 없음

Similar Papers 제목 키워드 기반

DI-Fusion: Online Implicit 3D Reconstruction with Deep Priors

2020-12-10 · CVPR 2021 1 · Jiahui Huang, Shi-Sheng Huang, Haoxuan Song, Shi-Min Hu

Previous online 3D dense reconstruction methods struggle to achieve the balance between memory storage and surface quality, largely due to the usage of stagnant underlying geometry representation, such as TSDF (truncated…

3D Reconstruction

KV-Tracker: Real-Time Pose Tracking with Transformers

2025-12-27 · Marwan Taher, Ignacio Alzugaray, Kirill Mazur, Xin Kong 외 arxiv

Multi-view 3D geometry networks offer a powerful prior but are prohibitively slow for real-time applications. We propose a novel way to adapt them for online use, enabling real-time 6-DoF pose tracking and online reconst…

Object TrackingPose Tracking

MonoNeuralFusion: Online Monocular Neural 3D Reconstruction with Geometric Priors

2022-09-30 · Zi-Xin Zou, Shi-Sheng Huang, Yan-Pei Cao, Tai-Jiang Mu 외

High-fidelity 3D scene reconstruction from monocular videos continues to be challenging, especially for complete and fine-grained geometry reconstruction. The previous 3D reconstruction approaches with neural implicit re…

3D Reconstruction3D Scene Reconstruction

AiSDF: Structure-aware Neural Signed Distance Fields in Indoor Scenes

2024-03-04 · Jaehoon Jang, Inha Lee, Minje Kim, Kyungdon Joo

Indoor scenes we are living in are visually homogenous or textureless, while they inherently have structural forms and provide enough structural priors for 3D scene reconstruction. Motivated by this fact, we propose a st…

3D Scene Reconstruction

Hand3R: Online 4D Hand-Scene Reconstruction in the Wild

2026-02-03 · Wendi Hu, Haonan Zhou, Wenhao Hu, Gaoang Wang arxiv

For Embodied AI, jointly reconstructing dynamic hands and the dense scene context is crucial for understanding physical interaction. However, most existing methods recover isolated hands in local coordinates, overlooking…