paper-with-me

홈 › Papers

PoCo: Point Context Cluster for RGBD Indoor Place Recognition

2024-04-03 · Jing Liang, Zhuo Deng, Zheming Zhou, Omid Ghasemalizadeh, Dinesh Manocha, Min Sun, Cheng-Hao Kuo, Arnie Sen

We present a novel end-to-end algorithm (PoCo) for the indoor RGB-D place recognition task, aimed at identifying the most likely match for a given query frame within a reference database. The task presents inherent challenges attributed to the constrained field of view and limited range of perception sensors. We propose a new network architecture, which generalizes the recent Context of Clusters (CoCs) to extract global descriptors directly from the noisy point clouds through end-to-end learning. Moreover, we develop the architecture by integrating both color and geometric modalities into the point features to enhance the global descriptor representation. We conducted evaluations on public datasets ScanNet-PR and ARKit with 807 and 5047 scenarios, respectively. PoCo achieves SOTA performance: on ScanNet-PR, we achieve R@1 of 64.63%, a 5.7% improvement from the best-published result CGis (61.12%); on Arkit, we achieve R@1 of 45.12%, a 13.3% improvement from the best-published result CGis (39.82%). In addition, PoCo shows higher efficiency than CGis in inference time (1.75X-faster), and we demonstrate the effectiveness of PoCo in recognizing places within a real-world laboratory environment.

📄 PDF Abstract BibTeX arXiv:2404.02885

Code (1)

jinggm/poco-ccr 공식 구현 pytorch

Similar Papers 제목 키워드 기반

CSCPR: Cross-Source-Context Indoor RGB-D Place Recognition

2024-07-24 · Jing Liang, Zhuo Deng, Zheming Zhou, Min Sun 외

We extend our previous work, PoCo, and present a new algorithm, Cross-Source-Context Place Recognition (CSCPR), for RGB-D indoor place recognition that integrates global retrieval and reranking into an end-to-end model a…

RerankingRetrieval

POCO: Scalable Neural Forecasting through Population Conditioning

2025-06-17 · Yu Duan, Hamza Tahir Chaudhry, Misha B. Ahrens, Christopher D Harvey 외

Predicting future neural activity is a core challenge in modeling brain dynamics, with applications ranging from scientific investigation to closed-loop neurotechnology. While recent models of population activity emphasi…

Exploiting 2D Floorplan for Building-scale Panorama RGBD Alignment

2016-12-08 · CVPR 2017 7 · Erik Wijmans, Yasutaka Furukawa

This paper presents a novel algorithm that utilizes a 2D floorplan to align panorama RGBD scans. While effective panorama RGBD alignment techniques exist, such a system requires extremely dense RGBD image sampling. Our a…

Structure-From-Motion and RGBD Depth Fusion

2021-03-10 · Akash Chandrashekar, John Papadakis, Andrew Willis, Jamie Gantert

This article describes a technique to augment a typical RGBD sensor by integrating depth estimates obtained via Structure-from-Motion (SfM) with sensor depth measurements. Limitations in the RGBD depth sensing technology…

Object Recognition

PerspectiveNet: A Scene-consistent Image Generator for New View Synthesis in Real Indoor Environments

2019-12-01 · NeurIPS 2019 12 · Ben Graham, David Novotny, Jeremy Reizenstein

Given a set of a reference RGBD views of an indoor environment, and a new viewpoint, our goal is to predict the view from that location. Prior work on new-view generation has predominantly focused on significantly constr…