6D Object Pose Estimation using Keypoints and Part Affinity Fields
The task of 6D object pose estimation from RGB images is an important requirement for autonomous service robots to be able to interact with the real world. In this work, we present a two-step pipeline for estimating the 6 DoF translation and orientation of known objects. Keypoints and Part Affinity Fields (PAFs) are predicted from the input image adopting the OpenPose CNN architecture from human pose estimation. Object poses are then calculated from 2D-3D correspondences between detected and model keypoints via the PnP-RANSAC algorithm. The proposed approach is evaluated on the YCB-Video dataset and achieves accuracy on par with recent methods from the literature. Using PAFs to assemble detected keypoints into object instances proves advantageous over only using heatmaps. Models trained to predict keypoints of a single object class perform significantly better than models trained for several classes.
Code (0)
등록된 구현이 없습니다.
Tasks
6D Pose Estimation using RGBObjectPose EstimationTranslationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Deep Affinity Net: Instance Segmentation via Affinity
Most of the modern instance segmentation approaches fall into two categories: region-based approaches in which object bounding boxes are detected first and later used in cropping and segmenting instances; and keypoint-ba…
Clusteringgraph partitioningInstance SegmentationSemantic SegmentationLearning Spatial Context with Graph Neural Network for Multi-Person Pose Grouping
Bottom-up approaches for image-based multi-person pose estimation consist of two stages: (1) keypoint detection and (2) grouping of the detected keypoints to form person instances. Current grouping approaches rely on lea…
ClusteringGraph Neural Networkgraph partitioningKeypoint Detection+2Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields
We present an approach to efficiently detect the 2D pose of multiple people in an image. The approach uses a nonparametric representation, which we refer to as Part Affinity Fields (PAFs), to learn to associate body part…
2D Human Pose Estimation2D Pose EstimationKeypoint DetectionMulti-Person Pose Estimation+2Keypoint Communities
We present a fast bottom-up method that jointly detects over 100 keypoints on humans or objects, also referred to as human/object pose estimation. We model all keypoints belonging to a human or an object -- the pose -- a…
2D Human Pose EstimationCar Pose EstimationKeypoint DetectionObject+1Self-Constrained Inference Optimization on Structural Groups for Human Pose Estimation
We observe that human poses exhibit strong group-wise structural correlation and spatial coupling between keypoints due to the biological constraints of different body parts. This group-wise structural correlation can be…
Inference OptimizationMulti-Person Pose EstimationPose EstimationPose Prediction+1