paper-with-me

Papers

SD-Net: Symmetric-Aware Keypoint Prediction and Domain Adaptation for 6D Pose Estimation In Bin-picking Scenarios

2024-03-14 · Ding-Tao Huang, En-Te Lin, Lipeng Chen, Li-Fu Liu, Long Zeng

Despite the success in 6D pose estimation in bin-picking scenarios, existing methods still struggle to produce accurate prediction results for symmetry objects and real world scenarios. The primary bottlenecks include 1) the ambiguity keypoints caused by object symmetries; 2) the domain gap between real and synthetic data. To circumvent these problem, we propose a new 6D pose estimation network with symmetric-aware keypoint prediction and self-training domain adaptation (SD-Net). SD-Net builds on pointwise keypoint regression and deep hough voting to perform reliable detection keypoint under clutter and occlusion. Specifically, at the keypoint prediction stage, we designe a robust 3D keypoints selection strategy considering the symmetry class of objects and equivalent keypoints, which facilitate locating 3D keypoints even in highly occluded scenes. Additionally, we build an effective filtering algorithm on predicted keypoint to dynamically eliminate multiple ambiguity and outlier keypoint candidates. At the domain adaptation stage, we propose the self-training framework using a student-teacher training scheme. To carefully distinguish reliable predictions, we harnesses a tailored heuristics for 3D geometry pseudo labelling based on semi-chamfer distance. On public Sil'eane dataset, SD-Net achieves state-of-the-art results, obtaining an average precision of 96%. Testing learning and generalization abilities on public Parametric datasets, SD-Net is 8% higher than the state-of-the-art method. The code is available at https://github.com/dingthuang/SD-Net.

📄 PDF Abstract BibTeX arXiv:2403.09317

Code (1)

dingthuang/sd-net 공식 구현 pytorch

Tasks

3D geometry6D Pose EstimationDomain AdaptationPose Estimation

Similar Papers 제목 키워드 기반

Unsupervised Domain Adaptation for 3D Keypoint Estimation via View Consistency

2017-12-15 · ECCV 2018 9 · Xingyi Zhou, Arjun Karpur, Chuang Gan, Linjie Luo 외

In this paper, we introduce a novel unsupervised domain adaptation technique for the task of 3D keypoint prediction from a single depth scan or image. Our key idea is to utilize the fact that predictions from different v…

Domain AdaptationKeypoint EstimationUnsupervised Domain Adaptation

DLTPose: 6DoF Pose Estimation From Accurate Dense Surface Point Estimates

2025-04-09 · Akash Jadhav, Michael Greenspan

We propose DLTPose, a novel method for 6DoF object pose estimation from RGB-D images that combines the accuracy of sparse keypoint methods with the robustness of dense pixel-wise predictions. DLTPose predicts per-pixel r…

ObjectPose Estimationvalid

Shape Consistent 2D Keypoint Estimation under Domain Shift

2020-08-04 · Levi O. Vasconcelos, Massimiliano Mancini, Davide Boscaini, Samuel Rota Bulo 외

Recent unsupervised domain adaptation methods based on deep architectures have shown remarkable performance not only in traditional classification tasks but also in more complex problems involving structured predictions …

Depth EstimationDomain AdaptationKeypoint EstimationSemantic Segmentation+1

VAPO: Visibility-Aware Keypoint Localization for Efficient 6DoF Object Pose Estimation

2024-03-21 · Ruyi Lian, Yuewei Lin, Longin Jan Latecki, Haibin Ling

Localizing predefined 3D keypoints in a 2D image is an effective way to establish 3D-2D correspondences for 6DoF object pose estimation. However, unreliable localization results of invisible keypoints degrade the quality…

ObjectPose Estimation

Geometry-Aware Symmetric Domain Adaptation for Monocular Depth Estimation

2019-04-03 · CVPR 2019 6 · Shanshan Zhao, Huan Fu, Mingming Gong, DaCheng Tao

Supervised depth estimation has achieved high accuracy due to the advanced deep network architectures. Since the groundtruth depth labels are hard to obtain, recent methods try to learn depth estimation networks in an un…

Depth EstimationDepth PredictionDomain AdaptationMonocular Depth Estimation+1