Category-Level 6D Object Pose Estimation in the Wild: A Semi-Supervised Learning Approach and A New Dataset
6D object pose estimation is one of the fundamental problems in computer vision and robotics research. While a lot of recent efforts have been made on generalizing pose estimation to novel object instances within the same category, namely category-level 6D pose estimation, it is still restricted in constrained environments given the limited number of annotated data. In this paper, we collect Wild6D, a new unlabeled RGBD object video dataset with diverse instances and backgrounds. We utilize this data to generalize category-level 6D object pose estimation in the wild with semi-supervised learning. We propose a new model, called Rendering for Pose estimation network RePoNet, that is jointly trained using the free ground-truths with the synthetic data, and a silhouette matching objective function on the real-world data. Without using any 3D annotations on real data, our method outperforms state-of-the-art methods on the previous dataset and our Wild6D test set (with manual annotations for evaluation) by a large margin. Project page with Wild6D data: https://oasisyang.github.io/semi-pose .
Code (0)
등록된 구현이 없습니다.
Tasks
6D Pose Estimation6D Pose Estimation using RGBObjectPose EstimationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
CPPF: Towards Robust Category-Level 9D Pose Estimation in the Wild
In this paper, we tackle the problem of category-level 9D pose estimation in the wild, given a single RGB-D frame. Using supervised data of real-world 9D poses is tedious and erroneous, and also fails to generalize to un…
6D Pose Estimation using RGBDPose EstimationSelf-Supervised Geometric Correspondence for Category-Level 6D Object Pose Estimation in the Wild
While 6D object pose estimation has wide applications across computer vision and robotics, it remains far from being solved due to the lack of annotations. The problem becomes even more challenging when moving to categor…
6D Pose Estimation6D Pose Estimation using RGBObjectPose Estimation+1MemPose: Category-level Object Pose Estimation with Memory
In the pursuit of robust and generalizable category-level object pose estimation, most existing methods adopt parametric formulations that learn effective representations from data, yet they primarily encode category-lev…
Pose EstimationUniversal Features Guided Zero-Shot Category-Level Object Pose Estimation
Object pose estimation, crucial in computer vision and robotics applications, faces challenges with the diversity of unseen categories. We propose a zero-shot method to achieve category-level 6-DOF object pose estimation…
DiversityPose EstimationSemantic SimilaritySemantic Textual SimilarityEmergence of a Shared Canonical Object Frame from In-the-Wild Videos
Comparing object orientations and positions across different instances requires their poses to be expressed in a shared canonical frame. Establishing such frames has traditionally required manual annotation, creating a s…
Pose Estimation