paper-with-me

홈 › Papers

Generative Category-level Object Pose Estimation via Diffusion Models

2023-09-21 · NeurIPS 2023 11

Object pose estimation plays a vital role in embodied AI and computer vision, enabling intelligent agents to comprehend and interact with their surroundings. Despite the practicality of category-level pose estimation, current approaches encounter challenges with partially observed point clouds, known as the multihypothesis issue. In this study, we propose a novel solution by reframing categorylevel object pose estimation as conditional generative modeling, departing from traditional point-to-point regression. Leveraging score-based diffusion models, we estimate object poses by sampling candidates from the diffusion model and aggregating them through a two-step process: filtering out outliers via likelihood estimation and subsequently mean-pooling the remaining candidates. To avoid the costly integration process when estimating the likelihood, we introduce an alternative method that distils an energy-based model from the original score-based model, enabling end-to-end likelihood estimation. Our approach achieves state-of-the-art performance on the REAL275 dataset, surpassing 50% and 60% on strict 5 ◦ 2cm and 5 ◦ 5cm metrics, respectively. Furthermore, our method demonstrates strong generalization to novel categories without the need for fine-tuning and can readily adapt to object pose tracking tasks, yielding comparable results to the current state-of-the-art baselines. Our checkpoints and demonstrations can be found at https://sites.google.com/view/genpose.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Probabilistic Category-Level Pose Estimation via Segmentation and Predicted-Shape Priors

2019-05-28 · Benjamin Burchfiel, George Konidaris

We introduce a new method for category-level pose estimation which produces a distribution over predicted poses by integrating 3D shape estimates from a generative object model with segmentation information. Given an inp…

ObjectPose EstimationSegmentation

Robust Category-Level 6D Pose Estimation with Coarse-to-Fine Rendering of Neural Features

2022-09-12 · Wufei Ma, Angtian Wang, Alan Yuille, Adam Kortylewski

We consider the problem of category-level 6D pose estimation from a single RGB image. Our approach represents an object category as a cuboid mesh and learns a generative model of the neural feature activations at each me…

6D Pose EstimationContrastive LearningObjectPose Estimation

GenPose: Generative Category-level Object Pose Estimation via Diffusion Models

2023-06-18 · Jiyao Zhang, Mingdong Wu, Hao Dong

Object pose estimation plays a vital role in embodied AI and computer vision, enabling intelligent agents to comprehend and interact with their surroundings. Despite the practicality of category-level pose estimation, cu…

6D Pose Estimation6D Pose Estimation using RGBDObjectPose Estimation+1

Generative Category-Level Shape and Pose Estimation with Semantic Primitives

2022-10-03 · Guanglin Li, Yifeng Li, Zhichao Ye, Qihang Zhang 외

Empowering autonomous agents with 3D understanding for daily objects is a grand challenge in robotics applications. When exploring in an unknown environment, existing methods for object pose estimation are still not sati…

6D Pose Estimation using RGBDDiversityObjectPose Estimation

Learning Canonical Shape Space for Category-Level 6D Object Pose and Size Estimation

2020-01-25 · CVPR 2020 6 · Dengsheng Chen, Jun Li, Zheng Wang, Kai Xu

We present a novel approach to category-level 6D object pose and size estimation. To tackle intra-class shape variations, we learn canonical shape space (CASS), a unified representation for a large variety of instances o…

3D Shape RepresentationGenerating 3D Point CloudsObject