Point Cloud Registration of non-rigid objects in sparse 3D Scans with applications in Mixed Reality
Point Cloud Registration is the problem of aligning the corresponding points of two 3D point clouds referring to the same object. The challenges include dealing with noise and partial match of real-world 3D scans. For non-rigid objects, there is an additional challenge of accounting for deformations in the object shape that happen to the object in between the two 3D scans. In this project, we study the problem of non-rigid point cloud registration for use cases in the Augmented/Mixed Reality domain. We focus our attention on a special class of non-rigid deformations that happen in rigid objects with parts that move relative to one another about joints, for example, robots with hands and machines with hinges. We propose an efficient and robust point-cloud registration workflow for such objects and evaluate it on real-world data collected using Microsoft Hololens 2, a leading Mixed Reality device.
Code (0)
등록된 구현이 없습니다.
Tasks
Mixed RealityObjectPoint Cloud RegistrationSimilar Papers 제목 키워드 기반
PWR-Align: Leveraging Part-Whole Relationships for Part-wise Rigid Point Cloud Registration in Mixed Reality Applications
We present an efficient and robust point cloud registration (PCR) workflow for part-wise rigid point cloud alignment using the Microsoft HoloLens 2. Point Cloud Registration (PCR) is an important problem in Augmented and…
Mixed RealityPoint Cloud RegistrationSynBench: A Synthetic Benchmark for Non-rigid 3D Point Cloud Registration
Non-rigid point cloud registration is a crucial task in computer vision. Evaluating a non-rigid point cloud registration method requires a dataset with challenges such as large deformation levels, noise, outliers, and in…
Point Cloud RegistrationRobust Feature-Based Point Registration Using Directional Mixture Model
This paper presents a robust probabilistic point registration method for estimating the rigid transformation (i.e. rotation matrix and translation vector) between two pointcloud dataset. The method improves the robustnes…
TranslationHumanReg: Self-supervised Non-rigid Registration of Human Point Cloud
In this paper, we present a novel registration framework, HumanReg, that learns a non-rigid transformation between two human point clouds end-to-end. We introduce body prior into the registration process to efficiently h…
Deep Closest Point: Learning Representations for Point Cloud Registration
Point cloud registration is a key problem for computer vision applied to robotics, medical imaging, and other applications. This problem involves finding a rigid transformation from one point cloud into another so that t…
Point Cloud RegistrationVisual Localization