Fully-Geometric Cross-Attention for Point Cloud Registration
Point cloud registration approaches often fail when the overlap between point clouds is low due to noisy point correspondences. This work introduces a novel cross-attention mechanism tailored for Transformer-based architectures that tackles this problem, by fusing information from coordinates and features at the super-point level between point clouds. This formulation has remained unexplored primarily because it must guarantee rotation and translation invariance since point clouds reside in different and independent reference frames. We integrate the Gromov-Wasserstein distance into the cross-attention formulation to jointly compute distances between points across different point clouds and account for their geometric structure. By doing so, points from two distinct point clouds can attend to each other under arbitrary rigid transformations. At the point level, we also devise a self-attention mechanism that aggregates the local geometric structure information into point features for fine matching. Our formulation boosts the number of inlier correspondences, thereby yielding more precise registration results compared to state-of-the-art approaches. We have conducted an extensive evaluation on 3DMatch, 3DLoMatch, KITTI, and 3DCSR datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Point Cloud RegistrationSimilar Papers 제목 키워드 기반
Point Cloud Completion by Skip-attention Network with Hierarchical Folding
Point cloud completion aims to infer the complete geometries for missing regions of 3D objects from incomplete ones. Previous methods usually predict the complete point cloud based on the global shape representation extr…
DecoderPoint Cloud CompletionDeep Semantic Graph Matching for Large-scale Outdoor Point Clouds Registration
Current point cloud registration methods are mainly based on local geometric information and usually ignore the semantic information contained in the scenes. In this paper, we treat the point cloud registration problem a…
Graph MatchingPoint Cloud RegistrationSemantic SegmentationGAPrompt: Geometry-Aware Point Cloud Prompt for 3D Vision Model
Pre-trained 3D vision models have gained significant attention for their promising performance on point cloud data. However, fully fine-tuning these models for downstream tasks is computationally expensive and storage-in…
parameter-efficient fine-tuningGAPNet: Graph Attention based Point Neural Network for Exploiting Local Feature of Point Cloud
Exploiting fine-grained semantic features on point cloud is still challenging due to its irregular and sparse structure in a non-Euclidean space. Among existing studies, PointNet provides an efficient and promising appro…
Graph AttentionObitoNet: Multimodal High-Resolution Point Cloud Reconstruction
ObitoNet employs a Cross Attention mechanism to integrate multimodal inputs, where Vision Transformers (ViT) extract semantic features from images and a point cloud tokenizer processes geometric information using Farthes…
DecoderPoint Cloud GenerationPoint cloud reconstruction