Interpolated Convolutional Networks for 3D Point Cloud Understanding
Point cloud is an important type of 3D representation. However, directly applying convolutions on point clouds is challenging due to the sparse, irregular and unordered data structure. In this paper, we propose a novel Interpolated Convolution operation, InterpConv, to tackle the point cloud feature learning and understanding problem. The key idea is to utilize a set of discrete kernel weights and interpolate point features to neighboring kernel-weight coordinates by an interpolation function for convolution. A normalization term is introduced to handle neighborhoods of different sparsity levels. Our InterpConv is shown to be permutation and sparsity invariant, and can directly handle irregular inputs. We further design Interpolated Convolutional Neural Networks (InterpCNNs) based on InterpConv layers to handle point cloud recognition tasks including shape classification, object part segmentation and indoor scene semantic parsing. Experiments show that the networks can capture both fine-grained local structures and global shape context information effectively. The proposed approach achieves state-of-the-art performance on public benchmarks including ModelNet40, ShapeNet Parts and S3DIS.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Part Segmentation3D Point Cloud ClassificationSemantic ParsingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Spherical Interpolated Convolutional Network with Distance-Feature Density for 3D Semantic Segmentation of Point Clouds
The semantic segmentation of point clouds is an important part of the environment perception for robots. However, it is difficult to directly adopt the traditional 3D convolution kernel to extract features from raw 3D po…
3D Semantic SegmentationFeature CorrelationSemantic SegmentationStarNet: Style-Aware 3D Point Cloud Generation
This paper investigates an open research task of reconstructing and generating 3D point clouds. Most existing works of 3D generative models directly take the Gaussian prior as input for the decoder to generate 3D point c…
DecoderGenerating 3D Point CloudsPoint Cloud GenerationPoint cloud reconstructionSpatial-Temporal Consistency Refinement Network for Dynamic Point Cloud Frame Interpolation
Point cloud frame interpolation aims to improve the frame rate of a point cloud sequence by synthesising intermediate frames between consecutive frames. Most of the existing works only use the scene flow or features, not…
3D Point Cloud InterpolationMotion EstimationDSCnet: Replicating Lidar Point Clouds with Deep Sensor Cloning
Convolutional neural networks (CNNs) have become increasingly popular for solving a variety of computer vision tasks, ranging from image classification to image segmentation. Recently, autonomous vehicles have created a …
Autonomous VehiclesDepth EstimationDepth Predictionimage-classification+3GaussianPU: A Hybrid 2D-3D Upsampling Framework for Enhancing Color Point Clouds via 3D Gaussian Splatting
Dense colored point clouds enhance visual perception and are of significant value in various robotic applications. However, existing learning-based point cloud upsampling methods are constrained by computational resource…
3DGSGPUImage Restorationpoint cloud upsampling+2