Iterative Transformer Network for 3D Point Cloud
3D point cloud is an efficient and flexible representation of 3D structures. Recently, neural networks operating on point clouds have shown superior performance on 3D understanding tasks such as shape classification and part segmentation. However, performance on such tasks is evaluated on complete shapes aligned in a canonical frame, while real world 3D data are partial and unaligned. A key challenge in learning from partial, unaligned point cloud data is to learn features that are invariant or equivariant with respect to geometric transformations. To address this challenge, we propose the Iterative Transformer Network (IT-Net), a network module that canonicalizes the pose of a partial object with a series of 3D rigid transformations predicted in an iterative fashion. We demonstrate the efficacy of IT-Net as an anytime pose estimator from partial point clouds without using complete object models. Further, we show that IT-Net achieves superior performance over alternative 3D transformer networks on various tasks, such as partial shape classification and object part segmentation.
Code (1)
Tasks
General ClassificationObjectSegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Efficient Point Transformer with Dynamic Token Aggregating for LiDAR Point Cloud Processing
Recently, LiDAR point cloud processing and analysis have made great progress due to the development of 3D Transformers. However, existing 3D Transformer methods usually are computationally expensive and inefficient due t…
Taming Transformers for Realistic Lidar Point Cloud Generation
Diffusion Models (DMs) have achieved State-Of-The-Art (SOTA) results in the Lidar point cloud generation task, benefiting from their stable training and iterative refinement during sampling. However, DMs often fail to re…
DenoisingPoint Cloud Generation2D-3D Interlaced Transformer for Point Cloud Segmentation with Scene-Level Supervision
We present a Multimodal Interlaced Transformer (MIT) that jointly considers 2D and 3D data for weakly supervised point cloud segmentation. Research studies have shown that 2D and 3D features are complementary for point c…
DecoderPoint Cloud SegmentationSegmentationWeakly-supervised LearningRegion-Transformer: Self-Attention Region Based Class-Agnostic Point Cloud Segmentation
Point cloud segmentation, which helps us understand the environment of specific structures and objects, can be performed in class-specific and class-agnostic ways. We propose a novel region-based transformer model called…
Autonomous VehiclesPoint Cloud SegmentationSegmentationPoint-Voxel Adaptive Feature Abstraction for Robust Point Cloud Classification
Great progress has been made in point cloud classification with learning-based methods. However, complex scene and sensor inaccuracy in real-world application make point cloud data suffer from corruptions, such as occlus…
ClassificationPoint Cloud Classification