MatchNorm: Learning-based Point Cloud Registration for 6D Object Pose Estimation in the Real World
In this work, we tackle the task of estimating the 6D pose of an object from point cloud data. While recent learning-based approaches to addressing this task have shown great success on synthetic datasets, we have observed them to fail in the presence of real-world data. We thus analyze the causes of these failures, which we trace back to the difference between the feature distributions of the source and target point clouds, and the sensitivity of the widely-used SVD-based loss function to the range of rotation between the two point clouds. We address the first challenge by introducing a new normalization strategy, Match Normalization, and the second via the use of a loss function based on the negative log likelihood of point correspondences. Our two contributions are general and can be applied to many existing learning-based 3D object registration frameworks, which we illustrate by implementing them in two of them, DCP and IDAM. Our experiments on the real-scene TUD-L, LINEMOD and Occluded-LINEMOD datasets evidence the benefits of our strategies. They allow for the first time learning-based 3D object registration methods to achieve meaningful results on real-world data. We therefore expect them to be key to the future development of point cloud registration methods.
Code (0)
등록된 구현이 없습니다.
Tasks
6D Pose Estimation using RGBObjectPoint Cloud RegistrationPose EstimationSimilar Papers 제목 키워드 기반
3D Focusing-and-Matching Network for Multi-Instance Point Cloud Registration
Multi-instance point cloud registration aims to estimate the pose of all instances of a model point cloud in the whole scene. Existing methods all adopt the strategy of first obtaining the global correspondence and then …
ObjectPoint Cloud RegistrationPoint Cloud Registration of non-rigid objects in sparse 3D Scans with applications in Mixed Reality
Point Cloud Registration is the problem of aligning the corresponding points of two 3D point clouds referring to the same object. The challenges include dealing with noise and partial match of real-world 3D scans. For no…
Mixed RealityObjectPoint Cloud RegistrationPWR-Align: Leveraging Part-Whole Relationships for Part-wise Rigid Point Cloud Registration in Mixed Reality Applications
We present an efficient and robust point cloud registration (PCR) workflow for part-wise rigid point cloud alignment using the Microsoft HoloLens 2. Point Cloud Registration (PCR) is an important problem in Augmented and…
Mixed RealityPoint Cloud RegistrationDeep Learning-based Point Cloud Registration for Augmented Reality-guided Surgery
Point cloud registration aligns 3D point clouds using spatial transformations. It is an important task in computer vision, with applications in areas such as augmented reality (AR) and medical imaging. This work explores…
Deep LearningPoint Cloud RegistrationPCRDiffusion: Diffusion Probabilistic Models for Point Cloud Registration
We propose a new framework that formulates point cloud registration as a denoising diffusion process from noisy transformation to object transformation. During training stage, object transformation diffuses from ground-t…
DenoisingPoint Cloud Registration