paper-with-me

홈 › Papers

Context-Aware Transformer for 3D Point Cloud Automatic Annotation

2023-03-27 · Xiaoyan Qian, Chang Liu, Xiaojuan Qi, Siew-Chong Tan, Edmund Lam, Ngai Wong

3D automatic annotation has received increased attention since manually annotating 3D point clouds is laborious. However, existing methods are usually complicated, e.g., pipelined training for 3D foreground/background segmentation, cylindrical object proposals, and point completion. Furthermore, they often overlook the inter-object feature relation that is particularly informative to hard samples for 3D annotation. To this end, we propose a simple yet effective end-to-end Context-Aware Transformer (CAT) as an automated 3D-box labeler to generate precise 3D box annotations from 2D boxes, trained with a small number of human annotations. We adopt the general encoder-decoder architecture, where the CAT encoder consists of an intra-object encoder (local) and an inter-object encoder (global), performing self-attention along the sequence and batch dimensions, respectively. The former models intra-object interactions among points, and the latter extracts feature relations among different objects, thus boosting scene-level understanding. Via local and global encoders, CAT can generate high-quality 3D box annotations with a streamlined workflow, allowing it to outperform existing state-of-the-art by up to 1.79% 3D AP on the hard task of the KITTI test set.

📄 PDF Abstract BibTeX arXiv:2303.14893

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderObject

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Test 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Residual Connection 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Position-Wise Feed-Forward Layer 설명 없음

Similar Papers 제목 키워드 기반

Collect-and-Distribute Transformer for 3D Point Cloud Analysis

2023-06-02 · Haibo Qiu, Baosheng Yu, DaCheng Tao

Remarkable advancements have been made recently in point cloud analysis through the exploration of transformer architecture, but it remains challenging to effectively learn local and global structures within point clouds…

Point Cloud ClassificationPosition

3DVG-Transformer: Relation Modeling for Visual Grounding on Point Clouds

2021-01-01 · ICCV 2021 10 · Lichen Zhao, Daigang Cai, Lu Sheng, Dong Xu

Visual grounding on 3D point clouds is an emerging vision and language task that benefits various applications in understanding the 3D visual world. By formulating this task as a grounding-by-detection problem, lots …

ObjectObject Proposal GenerationRelationVisual Grounding

3D Object Detection with Pointformer

2020-12-21 · CVPR 2021 1 · Xuran Pan, Zhuofan Xia, Shiji Song, Li Erran Li 외

Feature learning for 3D object detection from point clouds is very challenging due to the irregularity of 3D point cloud data. In this paper, we propose Pointformer, a Transformer backbone designed for 3D point clouds to…

3D Object DetectionObjectobject-detectionObject Detection+1

PoinTr: Diverse Point Cloud Completion with Geometry-Aware Transformers

2021-08-19 · ICCV 2021 10 · Xumin Yu, Yongming Rao, Ziyi Wang, Zuyan Liu 외

Point clouds captured in real-world applications are often incomplete due to the limited sensor resolution, single viewpoint, and occlusion. Therefore, recovering the complete point clouds from partial ones becomes an in…

DecoderInductive BiasPoint Cloud CompletionPoint Cloud Generation+1

Full Point Encoding for Local Feature Aggregation in 3D Point Clouds

2023-03-08 · Yong He, Hongshan Yu, Zhengeng Yang, Xiaoyan Liu 외

Point cloud processing methods exploit local point features and global context through aggregation which does not explicity model the internal correlations between local and global features. To address this problem, we p…

object-detectionObject DetectionPositionSemantic Segmentation