paper-with-me

Papers

SGMNet: Learning Rotation-Invariant Point Cloud Representations via Sorted Gram Matrix

2021-01-01 · ICCV 2021 10 · Jianyun Xu, Xin Tang, Yushi Zhu, Jie Sun, ShiLiang Pu

Recently, various works that attempted to introduce rotation invariance to point cloud analysis have devised point-pair features, such as angles and distances. In these methods, however, the point-pair is only comprised of the center point and its adjacent points in a vicinity, which may bring information loss to the local feature representation. In this paper, we instead connect each point densely with all other points in a local neighborhood to compose the point-pairs. Specifically, we present a simple but effective local feature representation, called sorted Gram matrix(SGM), which is not only invariant to arbitrary rotations, but also models the pair-wise relationship of all the points in a neighborhood. In more detail, we utilize vector inner product to model distance- and angle-information between two points, and in a local patch it naturally forms a Gram matrix. In order to guarantee permutation invariance, we sort the correlation value in Gram matrix for each point, therefore this geometric feature names sorted Gram matrix. Furthermore, we mathematically prove that the Gram matrix is rotation-invariant and sufficient to model the inherent structure of a point cloud patch. We then use SGM as features in convolution, which can be readily integrated as a drop-in module into any point-based networks. Finally, we evaluated the proposed method on two widely used datasets, and it outperforms previous state-of-the-arts on both shape classification and part segmentation tasks by a large margin.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

SRINet: Learning Strictly Rotation-Invariant Representations for Point Cloud Classification and Segmentation

2019-11-06 · Xiao Sun, Zhouhui Lian, Jianguo Xiao

Point cloud analysis has drawn broader attentions due to its increasing demands in various fields. Despite the impressive performance has been achieved on several databases, researchers neglect the fact that the orientat…

Data AugmentationGeneral ClassificationPoint Cloud Classification

A Rotation-Invariant Framework for Deep Point Cloud Analysis

2020-03-16 · Xianzhi Li, Ruihui Li, Guangyong Chen, Chi-Wing Fu 외

Recently, many deep neural networks were designed to process 3D point clouds, but a common drawback is that rotation invariance is not ensured, leading to poor generalization to arbitrary orientations. In this paper, we …

Point Cloud GenerationRetrieval

RI-MAE: Rotation-Invariant Masked AutoEncoders for Self-Supervised Point Cloud Representation Learning

2024-08-31 · Kunming Su, Qiuxia Wu, Panpan Cai, Xiaogang Zhu 외

Masked point modeling methods have recently achieved great success in self-supervised learning for point cloud data. However, these methods are sensitive to rotations and often exhibit sharp performance drops when encoun…

Representation LearningSelf-Supervised Learning

RIConv++: Effective Rotation Invariant Convolutions for 3D Point Clouds Deep Learning

2022-02-26 · Zhiyuan Zhang, Binh-Son Hua, Sai-Kit Yeung

3D point clouds deep learning is a promising field of research that allows a neural network to learn features of point clouds directly, making it a robust tool for solving 3D scene understanding tasks. While recent works…

3D Point Cloud ClassificationPoint Cloud SegmentationRetrievalScene Understanding

Deep Positional and Relational Feature Learning for Rotation-Invariant Point Cloud Analysis

2020-11-18 · ECCV 2020 8 · Ruixuan Yu, Xin Wei, Federico Tombari, Jian Sun

In this paper we propose a rotation-invariant deep network for point clouds analysis. Point-based deep networks are commonly designed to recognize roughly aligned 3D shapes based on point coordinates, but suffer from per…