paper-with-me

홈 › Papers

CheckerPose: Progressive Dense Keypoint Localization for Object Pose Estimation with Graph Neural Network

2023-03-29 · ICCV 2023 1 · Ruyi Lian, Haibin Ling

Estimating the 6-DoF pose of a rigid object from a single RGB image is a crucial yet challenging task. Recent studies have shown the great potential of dense correspondence-based solutions, yet improvements are still needed to reach practical deployment. In this paper, we propose a novel pose estimation algorithm named CheckerPose, which improves on three main aspects. Firstly, CheckerPose densely samples 3D keypoints from the surface of the 3D object and finds their 2D correspondences progressively in the 2D image. Compared to previous solutions that conduct dense sampling in the image space, our strategy enables the correspondence searching in a 2D grid (i.e., pixel coordinate). Secondly, for our 3D-to-2D correspondence, we design a compact binary code representation for 2D image locations. This representation not only allows for progressive correspondence refinement but also converts the correspondence regression to a more efficient classification problem. Thirdly, we adopt a graph neural network to explicitly model the interactions among the sampled 3D keypoints, further boosting the reliability and accuracy of the correspondences. Together, these novel components make CheckerPose a strong pose estimation algorithm. When evaluated on the popular Linemod, Linemod-O, and YCB-V object pose estimation benchmarks, CheckerPose clearly boosts the accuracy of correspondence-based methods and achieves state-of-the-art performances. Code is available at https://github.com/RuyiLian/CheckerPose.

📄 PDF Abstract BibTeX arXiv:2303.16874

Code (1)

ruyilian/checkerpose 공식 구현 pytorch

Tasks

Graph Neural NetworkPose Estimation

Methods 이 논문이 사용한 방법론

Graph Neural Network 설명 없음

Similar Papers 제목 키워드 기반

DKPMV: Dense Keypoints Fusion from Multi-View RGB Frames for 6D Pose Estimation of Textureless Objects

2025-10-13 · Jiahong Chen, Jinghao Wang, Zi Wang, Ziwen Wang 외 arxiv

6D pose estimation of textureless objects is valuable for industrial robotic applications, yet remains challenging due to the frequent loss of depth information. Current multi-view methods either rely on depth data or in…

6D Pose Estimation

Learning to Produce Semi-dense Correspondences for Visual Localization

2024-02-13 · CVPR 2024 1 · Khang Truong Giang, Soohwan Song, Sungho Jo

This study addresses the challenge of performing visual localization in demanding conditions such as night-time scenarios, adverse weather, and seasonal changes. While many prior studies have focused on improving image-m…

Camera Pose EstimationPose EstimationVisual Localization

Structure-from-Motion using Dense CNN Features with Keypoint Relocalization

2018-05-10 · Aji Resindra Widya, Akihiko Torii, Masatoshi Okutomi

Structure from Motion (SfM) using imagery that involves extreme appearance changes is yet a challenging task due to a loss of feature repeatability. Using feature correspondences obtained by matching densely extracted co…

3D-SPS: Single-Stage 3D Visual Grounding via Referred Point Progressive Selection

2022-04-13 · CVPR 2022 1 · Junyu Luo, Jiahui Fu, Xianghao Kong, Chen Gao 외

3D visual grounding aims to locate the referred target object in 3D point cloud scenes according to a free-form language description. Previous methods mostly follow a two-stage paradigm, i.e., language-irrelevant detecti…

3D visual groundingVisual Grounding

D2Det: Towards High Quality Object Detection and Instance Segmentation

2020-06-01 · CVPR 2020 6 · Jiale Cao, Hisham Cholakkal, Rao Muhammad Anwer, Fahad Shahbaz Khan 외

We propose a novel two-stage detection method, D2Det, that collectively addresses both precise localization and accurate classification. For precise localization, we introduce a dense local regression that predicts multi…

Instance SegmentationObjectobject-detectionObject Detection+3