paper-with-me

홈 › Papers

Rethinking Point Cloud Registration as Masking and Reconstruction

2023-01-01 · ICCV 2023 1 · Guangyan Chen, Meiling Wang, Li Yuan, Yi Yang, Yufeng Yue

Point cloud registration is essential in computer vision and robotics. In this paper, a critical observation is made that the invisible parts of each point cloud can be directly utilized as inherent masks, and the aligned point cloud pair can be regarded as the reconstruction target. Motivated by this observation, we rethink the point cloud registration problem as a masking and reconstruction task. To this end, a generic and concise auxiliary training network, the Masked Reconstruction Auxiliary Network (MRA), is proposed. The MRA reconstructs the complete point cloud by separately using the encoded features of each point cloud obtained from the backbone, guiding the contextual features in the backbone to capture fine-grained geometric details and the overall structures of point cloud pairs. Unlike recently developed high-performing methods that incorporate specific encoding methods into transformer models, which sacrifice versatility and introduce significant computational complexity during the inference process, our MRA can be easily inserted into other methods to further improve registration accuracy. Additionally, the MRA is detached after training, thereby avoiding extra computational complexity during the inference process. Building upon the MRA, we present a novel transformer-based method, the Masked Reconstruction Transformer (MRT), which achieves both precise and efficient alignment using standard transformers. Extensive experiments conducted on the 3DMatch, ModelNet40, and KITTI datasets demonstrate the superior performance of our MRT over state-of-the-art methods, and the efficiency of the MRA in improving registration accuracy.

📄 PDF Abstract BibTeX

Code (1)

cguangyan-bit/mra 공식 구현

Tasks

Point Cloud Registration

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

3D Focusing-and-Matching Network for Multi-Instance Point Cloud Registration

2024-11-12 · Liyuan Zhang, Le Hui, Qi Liu, Bo Li 외

Multi-instance point cloud registration aims to estimate the pose of all instances of a model point cloud in the whole scene. Existing methods all adopt the strategy of first obtaining the global correspondence and then …

ObjectPoint Cloud Registration

ColabSfM: Collaborative Structure-from-Motion by Point Cloud Registration

2025-03-21 · CVPR 2025 1 · Johan Edstedt, André Mateus, Alberto Jaenal

Structure-from-Motion (SfM) is the task of estimating 3D structure and camera poses from images. We define Collaborative SfM (ColabSfM) as sharing distributed SfM reconstructions. Sharing maps requires estimating a joint…

Dataset GenerationPoint Cloud Registration

Point-DAE: Denoising Autoencoders for Self-supervised Point Cloud Learning

2022-11-13 · Yabin Zhang, Jiehong Lin, Ruihuang Li, Kui Jia 외

Masked autoencoder has demonstrated its effectiveness in self-supervised point cloud learning. Considering that masking is a kind of corruption, in this work we explore a more general denoising autoencoder for point clou…

3D Object DetectionDecoderDenoisingFew-Shot Learning+2

APR: Online Distant Point Cloud Registration Through Aggregated Point Cloud Reconstruction

2023-05-04 · Quan Liu, Yunsong Zhou, Hongzi Zhu, Shan Chang 외

For many driving safety applications, it is of great importance to accurately register LiDAR point clouds generated on distant moving vehicles. However, such point clouds have extremely different point density and sensor…

Point cloud reconstructionPoint Cloud Registration

RegHEC: Hand-Eye Calibration via Simultaneous Multi-view Point Clouds Registration of Arbitrary Object

2023-04-27 · Shiyu Xing, Fengshui Jing, Min Tan

RegHEC is a registration-based hand-eye calibration technique with no need for accurate calibration rig but arbitrary available objects, applicable for both eye-in-hand and eye-to-hand cases. It tries to find the hand-ey…

Bayesian OptimizationMotion EstimationPoint Cloud RegistrationRelation