KPConv: Flexible and Deformable Convolution for Point Clouds
We present Kernel Point Convolution (KPConv), a new design of point convolution, i.e. that operates on point clouds without any intermediate representation. The convolution weights of KPConv are located in Euclidean space by kernel points, and applied to the input points close to them. Its capacity to use any number of kernel points gives KPConv more flexibility than fixed grid convolutions. Furthermore, these locations are continuous in space and can be learned by the network. Therefore, KPConv can be extended to deformable convolutions that learn to adapt kernel points to local geometry. Thanks to a regular subsampling strategy, KPConv is also efficient and robust to varying densities. Whether they use deformable KPConv for complex tasks, or rigid KPconv for simpler tasks, our networks outperform state-of-the-art classification and segmentation approaches on several datasets. We also offer ablation studies and visualizations to provide understanding of what has been learned by KPConv and to validate the descriptive power of deformable KPConv.
Code (10)
Tasks
3D Part Segmentation3D Point Cloud Classification3D Semantic SegmentationDescriptiveLIDAR Semantic SegmentationRobust 3D Semantic SegmentationScene SegmentationSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Composite Convolution: a Flexible Operator for Deep Learning on 3D Point Clouds
Deep neural networks require specific layers to process point clouds, as the scattered and irregular location of 3D points prevents the use of conventional convolutional filters. We introduce the composite layer, a flexi…
Anomaly DetectionUnsupervised Anomaly DetectionFA-KPConv: Introducing Euclidean Symmetries to KPConv via Frame Averaging
We present Frame-Averaging Kernel-Point Convolution (FA-KPConv), a neural network architecture built on top of the well-known KPConv, a widely adopted backbone for 3D point cloud analysis. Even though invariance and/or e…
Point Cloud ClassificationPoint Cloud RegistrationKPConvX: Modernizing Kernel Point Convolution with Kernel Attention
In the field of deep point cloud understanding, KPConv is a unique architecture that uses kernel points to locate convolutional weights in space, instead of relying on Multi-Layer Perceptron (MLP) encodings. While it ini…
3D Point Cloud ClassificationSemantic SegmentationAutomated Mobile Attention KPConv Networks via A Wide & Deep Predictor
Kernel Point Convolution (KPConv) achieves cutting-edge performance on 3D point cloud applications. Unfortunately, the large size of KPConv network limits its usage in mobile scenarios. In addition, we observe that KPCon…
3D Point Cloud ClassificationFeature EngineeringNeural Architecture SearchPoint Cloud ClassificationAutomated Mobile Attention KPConv Networks via a Wide and Deep Predictor
Kernel Point Convolution (KPConv) achieves cutting-edge performance on 3D point cloud applications. Unfortunately, the large size of KPConv network limits its usage in mobile scenarios. In addition, we observe that KPCon…
3D Point Cloud ClassificationFeature EngineeringNeural Architecture SearchPoint Cloud Classification+1