Deep Learning-based Point Cloud Registration for Augmented Reality-guided Surgery
Point cloud registration aligns 3D point clouds using spatial transformations. It is an important task in computer vision, with applications in areas such as augmented reality (AR) and medical imaging. This work explores the intersection of two research trends: the integration of AR into image-guided surgery and the use of deep learning for point cloud registration. The main objective is to evaluate the feasibility of applying deep learning-based point cloud registration methods for image-to-patient registration in augmented reality-guided surgery. We created a dataset of point clouds from medical imaging and corresponding point clouds captured with a popular AR device, the HoloLens 2. We evaluate three well-established deep learning models in registering these data pairs. While we find that some deep learning methods show promise, we show that a conventional registration pipeline still outperforms them on our challenging dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep LearningPoint Cloud RegistrationSimilar Papers 제목 키워드 기반
PWR-Align: Leveraging Part-Whole Relationships for Part-wise Rigid Point Cloud Registration in Mixed Reality Applications
We present an efficient and robust point cloud registration (PCR) workflow for part-wise rigid point cloud alignment using the Microsoft HoloLens 2. Point Cloud Registration (PCR) is an important problem in Augmented and…
Mixed RealityPoint Cloud RegistrationPoint Cloud Registration of non-rigid objects in sparse 3D Scans with applications in Mixed Reality
Point Cloud Registration is the problem of aligning the corresponding points of two 3D point clouds referring to the same object. The challenges include dealing with noise and partial match of real-world 3D scans. For no…
Mixed RealityObjectPoint Cloud RegistrationA Novel Visualization System of Using Augmented Reality in Knee Replacement Surgery: Enhanced Bidirectional Maximum Correntropy Algorithm
Background and aim: Image registration and alignment are the main limitations of augmented reality-based knee replacement surgery. This research aims to decrease the registration error, eliminate outcomes that are trappe…
AnatomyImage RegistrationPC2Model: ISPRS benchmark on 3D point cloud to model registration
Point cloud registration involves aligning one point cloud with another or with a three-dimensional (3D) model, enabling the integration of multimodal data into a unified representation. This is essential in applications…
Point Cloud RegistrationAutonomous DrivingPoint CloudsFast and Accurate Point Cloud Registration using Trees of Gaussian Mixtures
Point cloud registration sits at the core of many important and challenging 3D perception problems including autonomous navigation, SLAM, object/scene recognition, and augmented reality. In this paper, we present a new r…
Autonomous NavigationGPUPoint Cloud RegistrationScene Recognition