paper-with-me

홈 › Papers

GenPose: Generative Category-level Object Pose Estimation via Diffusion Models

2023-06-18 · Jiyao Zhang, Mingdong Wu, Hao Dong

Object pose estimation plays a vital role in embodied AI and computer vision, enabling intelligent agents to comprehend and interact with their surroundings. Despite the practicality of category-level pose estimation, current approaches encounter challenges with partially observed point clouds, known as the multihypothesis issue. In this study, we propose a novel solution by reframing categorylevel object pose estimation as conditional generative modeling, departing from traditional point-to-point regression. Leveraging score-based diffusion models, we estimate object poses by sampling candidates from the diffusion model and aggregating them through a two-step process: filtering out outliers via likelihood estimation and subsequently mean-pooling the remaining candidates. To avoid the costly integration process when estimating the likelihood, we introduce an alternative method that trains an energy-based model from the original score-based model, enabling end-to-end likelihood estimation. Our approach achieves state-of-the-art performance on the REAL275 dataset, surpassing 50% and 60% on strict 5d2cm and 5d5cm metrics, respectively. Furthermore, our method demonstrates strong generalizability to novel categories sharing similar symmetric properties without fine-tuning and can readily adapt to object pose tracking tasks, yielding comparable results to the current state-of-the-art baselines.

📄 PDF Abstract BibTeX arXiv:2306.10531

Code (0)

등록된 구현이 없습니다.

Tasks

6D Pose Estimation6D Pose Estimation using RGBDObjectPose EstimationPose Tracking

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Generative Category-level Object Pose Estimation via Diffusion Models

2023-09-21 · NeurIPS 2023 11

Object pose estimation plays a vital role in embodied AI and computer vision, enabling intelligent agents to comprehend and interact with their surroundings. Despite the practicality of category-level pose estimation, cu…

Roweisposes, Including Eigenposes, Supervised Eigenposes, and Fisherposes, for 3D Action Recognition

2020-06-28 · Benyamin Ghojogh, Fakhri Karray, Mark Crowley

Human action recognition is one of the important fields of computer vision and machine learning. Although various methods have been proposed for 3D action recognition, some of which are basic and some use deep learning, …

3D Action RecognitionAction RecognitionFace RecognitionTemporal Action Localization

Omni6DPose: A Benchmark and Model for Universal 6D Object Pose Estimation and Tracking

2024-06-06 · Jiyao Zhang, Weiyao Huang, Bo Peng, Mingdong Wu 외

6D Object Pose Estimation is a crucial yet challenging task in computer vision, suffering from a significant lack of large-scale datasets. This scarcity impedes comprehensive evaluation of model performance, limiting res…

6D Pose Estimation using RGBBenchmarkingMixed RealityObject+2

Learning Category-Level Generalizable Object Manipulation Policy via Generative Adversarial Self-Imitation Learning from Demonstrations

2022-03-04 · Hao Shen, Weikang Wan, He Wang

Generalizable object manipulation skills are critical for intelligent and multi-functional robots to work in real-world complex scenes. Despite the recent progress in reinforcement learning, it is still very challenging …

Imitation Learning

Probabilistic Category-Level Pose Estimation via Segmentation and Predicted-Shape Priors

2019-05-28 · Benjamin Burchfiel, George Konidaris

We introduce a new method for category-level pose estimation which produces a distribution over predicted poses by integrating 3D shape estimates from a generative object model with segmentation information. Given an inp…

ObjectPose EstimationSegmentation