paper-with-me

Papers

A Dynamic Keypoints Selection Network for 6DoF Pose Estimation

2021-10-24 · Haowen Sun, Taiyong Wang

6 DoF poses estimation problem aims to estimate the rotation and translation parameters between two coordinates, such as object world coordinate and camera world coordinate. Although some advances are made with the help of deep learning, how to full use scene information is still a problem. Prior works tackle the problem by pixel-wise feature fusion but need to randomly selecte numerous points from images, which can not satisfy the demands of fast inference simultaneously and accurate pose estimation. In this work, we present a novel deep neural network based on dynamic keypoints selection designed for 6DoF pose estimation from a single RGBD image. Our network includes three parts, instance semantic segmentation, edge points detection and 6DoF pose estimation. Given an RGBD image, our network is trained to predict pixel category and the translation to edge points and center points. Then, a least-square fitting manner is applied to estimate the 6DoF pose parameters. Specifically, we propose a dynamic keypoints selection algorithm to choose keypoints from the foreground feature map. It allows us to leverage geometric and appearance information. During 6DoF pose estimation, we utilize the instance semantic segmentation result to filter out background points and only use foreground points to finish edge points detection and 6DoF pose estimation. Experiments on two commonly used 6DoF estimation benchmark datasets, YCB-Video and LineMoD, demonstrate that our method outperforms the state-of-the-art methods and achieves significant improvements over other same category methods time efficiency.

📄 PDF Abstract BibTeX arXiv:2110.12401

Code (0)

등록된 구현이 없습니다.

Tasks

Pose EstimationSemantic SegmentationTranslation

Similar Papers 제목 키워드 기반

SD-Net: Symmetric-Aware Keypoint Prediction and Domain Adaptation for 6D Pose Estimation In Bin-picking Scenarios

2024-03-14 · Ding-Tao Huang, En-Te Lin, Lipeng Chen, Li-Fu Liu 외

Despite the success in 6D pose estimation in bin-picking scenarios, existing methods still struggle to produce accurate prediction results for symmetry objects and real world scenarios. The primary bottlenecks include 1)…

3D geometry6D Pose EstimationDomain AdaptationPose Estimation

Pose Estimation for Robot Manipulators via Keypoint Optimization and Sim-to-Real Transfer

2020-10-15 · Jingpei Lu, Florian Richter, Michael Yip

Keypoint detection is an essential building block for many robotic applications like motion capture and pose estimation. Historically, keypoints are detected using uniquely engineered markers such as checkerboards or fid…

Keypoint DetectionPose Estimation

Keypoint-based Dynamic Object 6-DoF Pose Tracking via Event Camera

2026-04-25 · Zhe Wang, Qijin Song, Zihao Li, Jingyu Xiao 외 arxiv

Accurate 6-DoF pose estimation of objects is critical for robots to perform precise manipulation tasks. However, for dynamic object pose estimation, conventional camera-based approaches face several major challenges, suc…

Keypoint DetectionPose EstimationPose Tracking

Keypoints as Dynamic Centroids for Unified Human Pose and Segmentation

2025-05-17 · Niaz Ahmad, Jawad Khan, Kang G. Shin, Youngmoon Lee 외

The dynamic movement of the human body presents a fundamental challenge for human pose estimation and body segmentation. State-of-the-art approaches primarily rely on combining keypoint heatmaps with segmentation masks b…

Keypoint DetectionPose EstimationSegmentation

SelfGeo: Self-supervised and Geodesic-consistent Estimation of Keypoints on Deformable Shapes

2024-08-05 · Mohammad Zohaib, Luca Cosmo, Alessio Del Bue

Unsupervised 3D keypoints estimation from Point Cloud Data (PCD) is a complex task, even more challenging when an object shape is deforming. As keypoints should be semantically and geometrically consistent across all the…