paper-with-me

홈 › Papers

Robust Neural Routing Through Space Partitions for Camera Relocalization in Dynamic Indoor Environments

2020-12-08 · CVPR 2021 1 · Siyan Dong, Qingnan Fan, He Wang, Ji Shi, Li Yi, Thomas Funkhouser, Baoquan Chen, Leonidas Guibas

Localizing the camera in a known indoor environment is a key building block for scene mapping, robot navigation, AR, etc. Recent advances estimate the camera pose via optimization over the 2D/3D-3D correspondences established between the coordinates in 2D/3D camera space and 3D world space. Such a mapping is estimated with either a convolution neural network or a decision tree using only the static input image sequence, which makes these approaches vulnerable to dynamic indoor environments that are quite common yet challenging in the real world. To address the aforementioned issues, in this paper, we propose a novel outlier-aware neural tree which bridges the two worlds, deep learning and decision tree approaches. It builds on three important blocks: (a) a hierarchical space partition over the indoor scene to construct the decision tree; (b) a neural routing function, implemented as a deep classification network, employed for better 3D scene understanding; and (c) an outlier rejection module used to filter out dynamic points during the hierarchical routing process. Our proposed algorithm is evaluated on the RIO-10 benchmark developed for camera relocalization in dynamic indoor environments. It achieves robust neural routing through space partitions and outperforms the state-of-the-art approaches by around 30% on camera pose accuracy, while running comparably fast for evaluation.

📄 PDF Abstract BibTeX arXiv:2012.04746

Code (1)

siyandong/NeuralRouting 공식 구현 pytorch

Tasks

Camera RelocalizationRobot NavigationScene Understanding

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

PlanaReLoc: Camera Relocalization in 3D Planar Primitives via Region-Based Structure Matching

2026-03-21 · Hanqiao Ye, Yuzhou Liu, Yangdong Liu, Shuhan Shen arxiv

While structure-based relocalizers have long strived for point correspondences when establishing or regressing query-map associations, in this paper, we pioneer the use of planar primitives and 3D planar maps for lightwe…

KFNet: Learning Temporal Camera Relocalization using Kalman Filtering

2020-03-24 · CVPR 2020 6 · Lei Zhou, Zixin Luo, Tianwei Shen, Jiahui Zhang 외

Temporal camera relocalization estimates the pose with respect to each video frame in sequence, as opposed to one-shot relocalization which focuses on a still image. Even though the time dependency has been taken into ac…

Camera Relocalization

S3E-GNN: Sparse Spatial Scene Embedding with Graph Neural Networks for Camera Relocalization

2022-05-12 · Ran Cheng, Xinyu Jiang, Yuan Chen, Lige Liu 외

Camera relocalization is the key component of simultaneous localization and mapping (SLAM) systems. This paper proposes a learning-based approach, named Sparse Spatial Scene Embedding with Graph Neural Networks (S3E-GNN)…

Camera RelocalizationSimultaneous Localization and Mapping

Semantic Object-level Modeling for Robust Visual Camera Relocalization

2024-02-10 · Yifan Zhu, Lingjuan Miao, Haitao Wu, Zhiqiang Zhou 외

Visual relocalization is crucial for autonomous visual localization and navigation of mobile robotics. Due to the improvement of CNN-based object detection algorithm, the robustness of visual relocalization is greatly en…

Camera RelocalizationObjectobject-detectionObject Detection+1

Camera Relocalization in Shadow-free Neural Radiance Fields

2024-05-23 · Shiyao Xu, Caiyun Liu, Yuantao Chen, Zhenxin Zhu 외

Camera relocalization is a crucial problem in computer vision and robotics. Recent advancements in neural radiance fields (NeRFs) have shown promise in synthesizing photo-realistic images. Several works have utilized NeR…

Camera RelocalizationNeRF