PointASNL: Robust Point Clouds Processing using Nonlocal Neural Networks with Adaptive Sampling
Raw point clouds data inevitably contains outliers or noise through acquisition from 3D sensors or reconstruction algorithms. In this paper, we present a novel end-to-end network for robust point clouds processing, named PointASNL, which can deal with point clouds with noise effectively. The key component in our approach is the adaptive sampling (AS) module. It first re-weights the neighbors around the initial sampled points from farthest point sampling (FPS), and then adaptively adjusts the sampled points beyond the entire point cloud. Our AS module can not only benefit the feature learning of point clouds, but also ease the biased effect of outliers. To further capture the neighbor and long-range dependencies of the sampled point, we proposed a local-nonlocal (L-NL) module inspired by the nonlocal operation. Such L-NL module enables the learning process insensitive to noise. Extensive experiments verify the robustness and superiority of our approach in point clouds processing tasks regardless of synthesis data, indoor data, and outdoor data with or without noise. Specifically, PointASNL achieves state-of-the-art robust performance for classification and segmentation tasks on all datasets, and significantly outperforms previous methods on real-world outdoor SemanticKITTI dataset with considerate noise. Our code is released through https://github.com/yanx27/PointASNL.
Code (1)
Tasks
3D Point Cloud ClassificationSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Self-Contrastive Learning with Hard Negative Sampling for Self-supervised Point Cloud Learning
Point clouds have attracted increasing attention. Significant progress has been made in methods for point cloud analysis, which often requires costly human annotation as supervision. To address this issue, we propose a n…
Contrastive LearningPoint Cloud SegmentationRepresentation LearningSelf-Supervised Learning+1PointNLM: Point Nonlocal-Means for vegetation segmentation based on middle echo point clouds
Middle-echo, which covers one or a few corresponding points, is a specific type of 3D point cloud acquired by a multi-echo laser scanner. In this paper, we propose a novel approach for automatic segmentation of trees tha…
Point Cloud SegmentationSegmentationSemantic SegmentationRevisiting Nonlocal Self-Similarity from Continuous Representation
Nonlocal self-similarity (NSS) is an important prior that has been successfully applied in multi-dimensional data processing tasks, e.g., image and video recovery. However, existing NSS-based methods are solely suitable …
DenoisingImage DenoisingImage InpaintingA Nonlocal InSAR Filter for High-Resolution DEM Generation from TanDEM-X Interferograms
This paper presents a nonlocal InSAR filter with the goal of generating digital elevation models of higher resolution and accuracy from bistatic TanDEM-X strip map interferograms than with the processing chain used in pr…
DenoisingDiversitySpectral Nonlocal Block for Neural Network
The nonlocal network is designed for capturing long-range spatial-temporal dependencies in several computer vision tasks. Although having shown excellent performances, it needs an elaborate preparation for both the numbe…
Video Classification