Geometry Sharing Network for 3D Point Cloud Classification and Segmentation
In spite of the recent progresses on classifying 3D point cloud with deep CNNs, large geometric transformations like rotation and translation remain challenging problem and harm the final classification performance. To address this challenge, we propose Geometry Sharing Network (GS-Net) which effectively learns point descriptors with holistic context to enhance the robustness to geometric transformations. Compared with previous 3D point CNNs which perform convolution on nearby points, GS-Net can aggregate point features in a more global way. Specially, GS-Net consists of Geometry Similarity Connection (GSC) modules which exploit Eigen-Graph to group distant points with similar and relevant geometric information, and aggregate features from nearest neighbors in both Euclidean space and Eigenvalue space. This design allows GS-Net to efficiently capture both local and holistic geometric features such as symmetry, curvature, convexity and connectivity. Theoretically, we show the nearest neighbors of each point in Eigenvalue space are invariant to rotation and translation. We conduct extensive experiments on public datasets, ModelNet40, ShapeNet Part. Experiments demonstrate that GS-Net achieves the state-of-the-art performances on major datasets, 93.3% on ModelNet40, and are more robust to geometric transformations.
Code (1)
Tasks
3D Point Cloud ClassificationClassificationGeneral ClassificationPoint Cloud ClassificationTranslationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
3DTI-Net: Learn Inner Transform Invariant 3D Geometry Features using Dynamic GCN
Deep learning on point clouds has made a lot of progress recently. Many point cloud dedicated deep learning frameworks, such as PointNet and PointNet++, have shown advantages in accuracy and speed comparing to those usin…
3D geometry3D Object ClassificationClassificationDeep Learning+2GeoSegNet: Point Cloud Semantic Segmentation via Geometric Encoder-Decoder Modeling
Semantic segmentation of point clouds, aiming to assign each point a semantic category, is critical to 3D scene understanding.Despite of significant advances in recent years, most of existing methods still suffer from ei…
DecoderObjectSegmentationSemantic SegmentationEllipsoidNet: Ellipsoid Representation for Point Cloud Classification and Segmentation
Point cloud patterns are hard to learn because of the implicit local geometry features among the orderless points. In recent years, point cloud representation in 2D space has attracted increasing research interest since …
ClassificationGeneral ClassificationPoint Cloud ClassificationPointCaps: Raw Point Cloud Processing using Capsule Networks with Euclidean Distance Routing
Raw point cloud processing using capsule networks is widely adopted in classification, reconstruction, and segmentation due to its ability to preserve spatial agreement of the input data. However, most of the existing ca…
SegmentationPoint Discriminative Learning for Data-efficient 3D Point Cloud Analysis
3D point cloud analysis has drawn a lot of research attention due to its wide applications. However, collecting massive labelled 3D point cloud data is both time-consuming and labor-intensive. This calls for data-efficie…
3D Object Classification3D Part Segmentation3D Point Cloud ClassificationNatural Language Understanding+4