paper-with-me

Papers

SE(3) Diffusion Model-based Point Cloud Registration for Robust 6D Object Pose Estimation

2023-10-26 · NeurIPS 2023 11

In this paper, we introduce an SE(3) diffusion model-based point cloud registration framework for 6D object pose estimation in real-world scenarios. Our approach formulates the 3D registration task as a denoising diffusion process, which progressively refines the pose of the source point cloud to obtain a precise alignment with the model point cloud. Training our framework involves two operations: An SE(3) diffusion process and an SE(3) reverse process. The SE(3) diffusion process gradually perturbs the optimal rigid transformation of a pair of point clouds by continuously injecting noise (perturbation transformation). By contrast, the SE(3) reverse process focuses on learning a denoising network that refines the noisy transformation step-by-step, bringing it closer to the optimal transformation for accurate pose estimation. Unlike standard diffusion models used in linear Euclidean spaces, our diffusion model operates on the SE(3) manifold. This requires exploiting the linear Lie algebra $\mathfrak{se}(3)$ associated with SE(3) to constrain the transformation transitions during the diffusion and reverse processes. Additionally, to effectively train our denoising network, we derive a registration-specific variational lower bound as the optimization objective for model learning. Furthermore, we show that our denoising network can be constructed with a surrogate registration model, making our approach applicable to different deep registration networks. Extensive experiments demonstrate that our diffusion registration framework presents outstanding pose estimation performance on the real-world TUD-L, LINEMOD, and Occluded-LINEMOD datasets.

📄 PDF Abstract BibTeX arXiv:2310.17359

Code (1)

jiang-hb/diffusionreg pytorch

Tasks

6D Pose Estimation using RGBDenoisingPoint Cloud RegistrationPose Estimation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

PCRDiffusion: Diffusion Probabilistic Models for Point Cloud Registration

2023-12-11 · Yue Wu, Yongzhe Yuan, Xiaolong Fan, Xiaoshui Huang 외

We propose a new framework that formulates point cloud registration as a denoising diffusion process from noisy transformation to object transformation. During training stage, object transformation diffuses from ground-t…

DenoisingPoint Cloud Registration

RARE: Refine Any Registration of Pairwise Point Clouds via Zero-Shot Learning

2025-07-26 · Chengyu Zheng, Jin Huang, Honghua Chen, Mingqiang Wei arxiv

Recent research leveraging large-scale pretrained diffusion models has demonstrated the potential of using diffusion features to establish semantic correspondences in images. Inspired by advancements in diffusion-based t…

Point Cloud RegistrationZero-Shot LearningPoint Clouds

PosDiffNet: Positional Neural Diffusion for Point Cloud Registration in a Large Field of View with Perturbations

2024-01-06 · Rui She, Sijie Wang, Qiyu Kang, Kai Zhao 외

Point cloud registration is a crucial technique in 3D computer vision with a wide range of applications. However, this task can be challenging, particularly in large fields of view with dynamic objects, environmental noi…

Point Cloud RegistrationPosition

EADReg: Probabilistic Correspondence Generation with Efficient Autoregressive Diffusion Model for Outdoor Point Cloud Registration

2024-11-22 · Linrui Gong, Jiuming Liu, Junyi Ma, Lihao Liu 외

Diffusion models have shown the great potential in the point cloud registration (PCR) task, especially for enhancing the robustness to challenging cases. However, existing diffusion-based PCR methods primarily focus on i…

Point Cloud Registration

FreeReg: Image-to-Point Cloud Registration Leveraging Pretrained Diffusion Models and Monocular Depth Estimators

2023-10-05 · Haiping Wang, YuAn Liu, Bing Wang, Yujing Sun 외

Matching cross-modality features between images and point clouds is a fundamental problem for image-to-point cloud registration. However, due to the modality difference between images and points, it is difficult to learn…

Image to Point Cloud RegistrationMetric LearningPoint Cloud Registration