Self-supervised Learning of Point Clouds via Orientation Estimation
Point clouds provide a compact and efficient representation of 3D shapes. While deep neural networks have achieved impressive results on point cloud learning tasks, they require massive amounts of manually labeled data, which can be costly and time-consuming to collect. In this paper, we leverage 3D self-supervision for learning downstream tasks on point clouds with fewer labels. A point cloud can be rotated in infinitely many ways, which provides a rich label-free source for self-supervision. We consider the auxiliary task of predicting rotations that in turn leads to useful features for other tasks such as shape classification and 3D keypoint prediction. Using experiments on ShapeNet and ModelNet, we demonstrate that our approach outperforms the state-of-the-art. Moreover, features learned by our model are complementary to other self-supervised methods and combining them leads to further performance improvement.
Code (1)
Tasks
3D Point Cloud Linear ClassificationSelf-Supervised LearningUnsupervised 3D Point Cloud Linear EvaluationSimilar Papers 제목 키워드 기반
SE-ORNet: Self-Ensembling Orientation-aware Network for Unsupervised Point Cloud Shape Correspondence
Unsupervised point cloud shape correspondence aims to obtain dense point-to-point correspondences between point clouds without manually annotated pairs. However, humans and some animals have bilateral symmetry and variou…
3D Dense Shape CorrespondenceBody and Head Orientation Estimation from Low-Resolution Point Clouds in Surveillance Settings
We propose a system that estimates people's body and head orientations using low-resolution point cloud data from two LiDAR sensors. Our models make accurate estimations in real-world conversation settings where subjects…
ConDor: Self-Supervised Canonicalization of 3D Pose for Partial Shapes
Progress in 3D object understanding has relied on manually canonicalized shape datasets that contain instances with consistent position and orientation (3D pose). This has made it hard to generalize these methods to in-t…
3D Canonicalization3D Geometry Perception3D Part Segmentation3D Pose Estimation+1Self-Supervised Robust Scene Flow Estimation via the Alignment of Probability Density Functions
In this paper, we present a new self-supervised scene flow estimation approach for a pair of consecutive point clouds. The key idea of our approach is to represent discrete point clouds as continuous probability density …
Scene Flow EstimationSelf-Supervised LearningSelf-supervised Scene Flow EstimationSelf-Supervised Equivariant Learning for Oriented Keypoint Detection
Detecting robust keypoints from an image is an integral part of many computer vision problems, and the characteristic orientation and scale of keypoints play an important role for keypoint description and matching. Exist…
Camera Pose EstimationKeypoint DetectionPose EstimationSelf-Supervised Learning+1