paper-with-me

홈 › Papers

NEWTON: Neural View-Centric Mapping for On-the-Fly Large-Scale SLAM

2023-03-23 · Hidenobu Matsuki, Keisuke Tateno, Michael Niemeyer, Federico Tombari

Neural field-based 3D representations have recently been adopted in many areas including SLAM systems. Current neural SLAM or online mapping systems lead to impressive results in the presence of simple captures, but they rely on a world-centric map representation as only a single neural field model is used. To define such a world-centric representation, accurate and static prior information about the scene, such as its boundaries and initial camera poses, are required. However, in real-time and on-the-fly scene capture applications, this prior knowledge cannot be assumed as fixed or static, since it dynamically changes and it is subject to significant updates based on run-time observations. Particularly in the context of large-scale mapping, significant camera pose drift is inevitable, necessitating the correction via loop closure. To overcome this limitation, we propose NEWTON, a view-centric mapping method that dynamically constructs neural fields based on run-time observation. In contrast to prior works, our method enables camera pose updates using loop closures and scene boundary updates by representing the scene with multiple neural fields, where each is defined in a local coordinate system of a selected keyframe. The experimental results demonstrate the superior performance of our method over existing world-centric neural field-based SLAM systems, in particular for large-scale scenes subject to camera pose updates.

📄 PDF Abstract BibTeX arXiv:2303.13654

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Data-Centric AI for Tropical Agricultural Mapping: Challenges, Strategies and Scalable Solutions

2025-10-17 · Mateus Pinto da Silva, Sabrina P. L. P. Correa, Hugo N. Oliveira, Ian M. Nunes 외 arxiv

Mapping agriculture in tropical areas through remote sensing presents unique challenges, including the lack of high-quality annotated data, the elevated costs of labeling, data variability, and regional generalisation. T…

Data AugmentationActive Learning

360BEV: Panoramic Semantic Mapping for Indoor Bird's-Eye View

2023-03-21 · Zhifeng Teng, Jiaming Zhang, Kailun Yang, Kunyu Peng 외

Seeing only a tiny part of the whole is not knowing the full circumstance. Bird's-eye-view (BEV) perception, a process of obtaining allocentric maps from egocentric views, is restricted when using a narrow Field of View …

Semantic Segmentation

See like a Robot: Robot-Centric Pointmaps for Vision-Language-Action Models

2026-07-13 · Byungkun Lee, Dongyoon Hwang, Dongjin Kim, Hojoon Lee 외 hf

Vision-language-action (VLA) models predict robot actions from visual observations and language instructions. These actions are defined in the robot's own 3D coordinate frame, yet most VLAs observe the scene in the camer…

Neural-Initialized Newton: Accelerating Nonlinear Finite Elements via Operator Learning

2025-11-10 · Kianoosh Taghikhani, Yusuke Yamazaki, Jerry Paul Varghese, Markus Apel 외 arxiv

We propose a Newton-based scheme, initialized by neural operator predictions, to accelerate the parametric solution of nonlinear problems in computational solid mechanics. First, a physics informed conditional neural fie…

Egocentric Spatial Memory

2018-07-31 · Mengmi Zhang, Keng Teck Ma, Shih-Cheng Yen, Joo Hwee Lim 외

Egocentric spatial memory (ESM) defines a memory system with encoding, storing, recognizing and recalling the spatial information about the environment from an egocentric perspective. We introduce an integrated deep neur…

Feature Engineering