Segmentation-driven 6D Object Pose Estimation
The most recent trend in estimating the 6D pose of rigid objects has been to train deep networks to either directly regress the pose from the image or to predict the 2D locations of 3D keypoints, from which the pose can be obtained using a PnP algorithm. In both cases, the object is treated as a global entity, and a single pose estimate is computed. As a consequence, the resulting techniques can be vulnerable to large occlusions. In this paper, we introduce a segmentation-driven 6D pose estimation framework where each visible part of the objects contributes a local pose prediction in the form of 2D keypoint locations. We then use a predicted measure of confidence to combine these pose candidates into a robust set of 3D-to-2D correspondences, from which a reliable pose estimate can be obtained. We outperform the state-of-the-art on the challenging Occluded-LINEMOD and YCB-Video datasets, which is evidence that our approach deals well with multiple poorly-textured objects occluding each other. Furthermore, it relies on a simple enough architecture to achieve real-time performance.
Code (5)
Tasks
6D Pose Estimation6D Pose Estimation using RGBObjectPose EstimationPose PredictionSegmentationSimilar Papers 제목 키워드 기반
Semantics-Driven Unsupervised Learning for Monocular Depth and Ego-Motion Estimation
We propose a semantics-driven unsupervised learning approach for monocular depth and ego-motion estimation from videos in this paper. Recent unsupervised learning methods employ photometric errors between synthetic view …
Depth EstimationDepth PredictionMotion EstimationPosition+2Tracking by 3D Model Estimation of Unknown Objects in Videos
Most model-free visual object tracking methods formulate the tracking task as object location estimation given by a 2D segmentation or a bounding box in each video frame. We argue that this representation is limited and …
ObjectObject TrackingSegmentationVisual Object TrackingRain rendering for evaluating and improving robustness to bad weather
Rain fills the atmosphere with water particles, which breaks the common assumption that light travels unaltered from the scene to the camera. While it is well-known that rain affects computer vision algorithms, quantifyi…
Depth EstimationObjectobject-detectionObject Detection+2Car Segmentation and Pose Estimation using 3D Object Models
Image segmentation and 3D pose estimation are two key cogs in any algorithm for scene understanding. However, state-of-the-art CRF-based models for image segmentation rely mostly on 2D object models to construct top-down…
3D Pose EstimationImage SegmentationObjectPose Estimation+3Residual-driven Fuzzy C-Means Clustering for Image Segmentation
Due to its inferior characteristics, an observed (noisy) image's direct use gives rise to poor segmentation results. Intuitively, using its noise-free image can favorably impact image segmentation. Hence, the accurate es…
ClusteringImage SegmentationSegmentationSemantic Segmentation