paper-with-me

홈 › Papers

3D Point-to-Keypoint Voting Network for 6D Pose Estimation

2020-12-22 · Weitong Hua, Jiaxin Guo, Yue Wang, Rong Xiong

Object 6D pose estimation is an important research topic in the field of computer vision due to its wide application requirements and the challenges brought by complexity and changes in the real-world. We think fully exploring the characteristics of spatial relationship between points will help to improve the pose estimation performance, especially in the scenes of background clutter and partial occlusion. But this information was usually ignored in previous work using RGB image or RGB-D data. In this paper, we propose a framework for 6D pose estimation from RGB-D data based on spatial structure characteristics of 3D keypoints. We adopt point-wise dense feature embedding to vote for 3D keypoints, which makes full use of the structure information of the rigid body. After the direction vectors pointing to the keypoints are predicted by CNN, we use RANSAC voting to calculate the coordinate of the 3D keypoints, then the pose transformation can be easily obtained by the least square method. In addition, a spatial dimension sampling strategy for points is employed, which makes the method achieve excellent performance on small training sets. The proposed method is verified on two benchmark datasets, LINEMOD and OCCLUSION LINEMOD. The experimental results show that our method outperforms the state-of-the-art approaches, achieves ADD(-S) accuracy of 98.7\% on LINEMOD dataset and 52.6\% on OCCLUSION LINEMOD dataset in real-time.

📄 PDF Abstract BibTeX arXiv:2012.11938

Code (0)

등록된 구현이 없습니다.

Tasks

6D Pose EstimationPose Estimation

Similar Papers 제목 키워드 기반

Keypoint Cascade Voting for Point Cloud Based 6DoF Pose Estimation

2022-10-14 · Yangzheng Wu, Alireza Javaheri, Mohsen Zand, Michael Greenspan

We propose a novel keypoint voting 6DoF object pose estimation method, which takes pure unordered point cloud geometry as input without RGB information. The proposed cascaded keypoint voting method, called RCVPose3D, is …

Keypoint EstimationPose EstimationSemantic Segmentation

Human Pose Estimation using Deep Consensus Voting

2016-03-27 · Ita Lifshitz, Ethan Fetaya, Shimon Ullman

In this paper we consider the problem of human pose estimation from a single still image. We propose a novel approach where each location in the image votes for the position of each keypoint using a convolutional neural …

Pose EstimationPosition

6DoF Object Pose Estimation via Differentiable Proxy Voting Loss

2020-02-10 · Xin Yu, Zheyu Zhuang, Piotr Koniusz, Hongdong Li

Estimating a 6DOF object pose from a single image is very challenging due to occlusions or textureless appearances. Vector-field based keypoint voting has demonstrated its effectiveness and superiority on tackling those …

ObjectPose Estimation

KDFNet: Learning Keypoint Distance Field for 6D Object Pose Estimation

2021-09-21 · Xingyu Liu, Shun Iwase, Kris M. Kitani

We present KDFNet, a novel method for 6D object pose estimation from RGB images. To handle occlusion, many recent works have proposed to localize 2D keypoints through pixel-wise voting and solve a Perspective-n-Point (Pn…

6D Pose Estimation using RGBPose Estimation

PVN3D: A Deep Point-wise 3D Keypoints Voting Network for 6DoF Pose Estimation

2019-11-11 · CVPR 2020 6 · Yisheng He, Wei Sun, Haibin Huang, Jianran Liu 외

In this work, we present a novel data-driven method for robust 6DoF object pose estimation from a single RGBD image. Unlike previous methods that directly regressing pose parameters, we tackle this challenging task with …

6D Pose Estimation6D Pose Estimation using RGBDKeypoint DetectionPose Estimation