Context-Aware Transformer for 3D Point Cloud Automatic Annotation
3D automatic annotation has received increased attention since manually annotating 3D point clouds is laborious. However, existing methods are usually complicated, e.g., pipelined training for 3D foreground/background segmentation, cylindrical object proposals, and point completion. Furthermore, they often overlook the inter-object feature relation that is particularly informative to hard samples for 3D annotation. To this end, we propose a simple yet effective end-to-end Context-Aware Transformer (CAT) as an automated 3D-box labeler to generate precise 3D box annotations from 2D boxes, trained with a small number of human annotations. We adopt the general encoder-decoder architecture, where the CAT encoder consists of an intra-object encoder (local) and an inter-object encoder (global), performing self-attention along the sequence and batch dimensions, respectively. The former models intra-object interactions among points, and the latter extracts feature relations among different objects, thus boosting scene-level understanding. Via local and global encoders, CAT can generate high-quality 3D box annotations with a streamlined workflow, allowing it to outperform existing state-of-the-art by up to 1.79% 3D AP on the hard task of the KITTI test set.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderObjectMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Collect-and-Distribute Transformer for 3D Point Cloud Analysis
Remarkable advancements have been made recently in point cloud analysis through the exploration of transformer architecture, but it remains challenging to effectively learn local and global structures within point clouds…
Point Cloud ClassificationPosition3DVG-Transformer: Relation Modeling for Visual Grounding on Point Clouds
Visual grounding on 3D point clouds is an emerging vision and language task that benefits various applications in understanding the 3D visual world. By formulating this task as a grounding-by-detection problem, lots …
ObjectObject Proposal GenerationRelationVisual Grounding3D Object Detection with Pointformer
Feature learning for 3D object detection from point clouds is very challenging due to the irregularity of 3D point cloud data. In this paper, we propose Pointformer, a Transformer backbone designed for 3D point clouds to…
3D Object DetectionObjectobject-detectionObject Detection+1PoinTr: Diverse Point Cloud Completion with Geometry-Aware Transformers
Point clouds captured in real-world applications are often incomplete due to the limited sensor resolution, single viewpoint, and occlusion. Therefore, recovering the complete point clouds from partial ones becomes an in…
DecoderInductive BiasPoint Cloud CompletionPoint Cloud Generation+1Full Point Encoding for Local Feature Aggregation in 3D Point Clouds
Point cloud processing methods exploit local point features and global context through aggregation which does not explicity model the internal correlations between local and global features. To address this problem, we p…
object-detectionObject DetectionPositionSemantic Segmentation