PVN3D: A Deep Point-wise 3D Keypoints Voting Network for 6DoF Pose Estimation
In this work, we present a novel data-driven method for robust 6DoF object pose estimation from a single RGBD image. Unlike previous methods that directly regressing pose parameters, we tackle this challenging task with a keypoint-based approach. Specifically, we propose a deep Hough voting network to detect 3D keypoints of objects and then estimate the 6D pose parameters within a least-squares fitting manner. Our method is a natural extension of 2D-keypoint approaches that successfully work on RGB based 6DoF estimation. It allows us to fully utilize the geometric constraint of rigid objects with the extra depth information and is easy for a network to learn and optimize. Extensive experiments were conducted to demonstrate the effectiveness of 3D-keypoint detection in the 6D pose estimation task. Experimental results also show our method outperforms the state-of-the-art methods by large margins on several benchmarks. Code and video are available at https://github.com/ethnhe/PVN3D.git.
Code (3)
Tasks
6D Pose Estimation6D Pose Estimation using RGBDKeypoint DetectionPose EstimationSimilar Papers 제목 키워드 기반
PVNet: Pixel-wise Voting Network for 6DoF Pose Estimation
This paper addresses the challenge of 6DoF pose estimation from a single RGB image under severe occlusion or truncation. Many recent works have shown that a two-stage approach, which first detects keypoints and then solv…
6D Pose Estimation using RGBPose Estimation3D Point-to-Keypoint Voting Network for 6D Pose Estimation
Object 6D pose estimation is an important research topic in the field of computer vision due to its wide application requirements and the challenges brought by complexity and changes in the real-world. We think fully exp…
6D Pose EstimationPose EstimationKGpose: Keypoint-Graph Driven End-to-End Multi-Object 6D Pose Estimation via Point-Wise Pose Voting
This letter presents KGpose, a novel end-to-end framework for 6D pose estimation of multiple objects. Our approach combines keypoint-based method with learnable pose regression through `keypoint-graph', which is a graph …
6D Pose EstimationGraph EmbeddingObjectPose EstimationKeypoint Cascade Voting for Point Cloud Based 6DoF Pose Estimation
We propose a novel keypoint voting 6DoF object pose estimation method, which takes pure unordered point cloud geometry as input without RGB information. The proposed cascaded keypoint voting method, called RCVPose3D, is …
Keypoint EstimationPose EstimationSemantic SegmentationKDFNet: Learning Keypoint Distance Field for 6D Object Pose Estimation
We present KDFNet, a novel method for 6D object pose estimation from RGB images. To handle occlusion, many recent works have proposed to localize 2D keypoints through pixel-wise voting and solve a Perspective-n-Point (Pn…
6D Pose Estimation using RGBPose Estimation