Extend Your Own Correspondences: Unsupervised Distant Point Cloud Registration by Progressive Distance Extension
Registration of point clouds collected from a pair of distant vehicles provides a comprehensive and accurate 3D view of the driving scenario, which is vital for driving safety related applications, yet existing literature suffers from the expensive pose label acquisition and the deficiency to generalize to new data distributions. In this paper, we propose EYOC, an unsupervised distant point cloud registration method that adapts to new point cloud distributions on the fly, requiring no global pose labels. The core idea of EYOC is to train a feature extractor in a progressive fashion, where in each round, the feature extractor, trained with near point cloud pairs, can label slightly farther point cloud pairs, enabling self-supervision on such far point cloud pairs. This process continues until the derived extractor can be used to register distant point clouds. Particularly, to enable high-fidelity correspondence label generation, we devise an effective spatial filtering scheme to select the most representative correspondences to register a point cloud pair, and then utilize the aligned point clouds to discover more correct correspondences. Experiments show that EYOC can achieve comparable performance with state-of-the-art supervised methods at a lower training cost. Moreover, it outwits supervised methods regarding generalization performance on new data distributions.
Code (1)
Tasks
Point Cloud RegistrationSimilar Papers 제목 키워드 기반
Unsupervised learning-based long-term superpixel tracking
Finding correspondences between structural entities decomposing images is of high interest for computer vision applications. In particular, we analyze how to accurately track superpixels - visual primitives generated by …
Object TrackingSuperpixelsVideo Object TrackingGP-UNIT: Generative Prior for Versatile Unsupervised Image-to-Image Translation
Recent advances in deep learning have witnessed many successful unsupervised image-to-image translation models that learn correspondences between two visual domains without paired data. However, it is still a great chall…
Image-to-Image TranslationTranslationUnsupervised Image-To-Image TranslationvalidUnsupervised Pivot Translation for Distant Languages
Unsupervised neural machine translation (NMT) has attracted a lot of attention recently. While state-of-the-art methods for unsupervised translation usually perform well between similar languages (e.g., English-German tr…
Machine TranslationNMTTranslationA Representation Separation Perspective to Correspondences-free Unsupervised 3D Point Cloud Registration
3D point cloud registration in remote sensing field has been greatly advanced by deep learning based methods, where the rigid transformation is either directly regressed from the two point clouds (correspondences-free ap…
Point Cloud RegistrationUnsupervised Template-assisted Point Cloud Shape Correspondence Network
Unsupervised point cloud shape correspondence aims to establish point-wise correspondences between source and target point clouds. Existing methods obtain correspondences directly by computing point-wise feature similari…
3D Dense Shape Correspondence