paper-with-me

Papers

OcTr: Octree-based Transformer for 3D Object Detection

2023-03-22 · CVPR 2023 1 · Chao Zhou, Yanan Zhang, Jiaxin Chen, Di Huang

A key challenge for LiDAR-based 3D object detection is to capture sufficient features from large scale 3D scenes especially for distant or/and occluded objects. Albeit recent efforts made by Transformers with the long sequence modeling capability, they fail to properly balance the accuracy and efficiency, suffering from inadequate receptive fields or coarse-grained holistic correlations. In this paper, we propose an Octree-based Transformer, named OcTr, to address this issue. It first constructs a dynamic octree on the hierarchical feature pyramid through conducting self-attention on the top level and then recursively propagates to the level below restricted by the octants, which captures rich global context in a coarse-to-fine manner while maintaining the computational complexity under control. Furthermore, for enhanced foreground perception, we propose a hybrid positional embedding, composed of the semantic-aware positional embedding and attention mask, to fully exploit semantic and geometry clues. Extensive experiments are conducted on the Waymo Open Dataset and KITTI Dataset, and OcTr reaches newly state-of-the-art results.

📄 PDF Abstract BibTeX arXiv:2303.12621

Code (0)

등록된 구현이 없습니다.

Tasks

3D Object DetectionObjectobject-detectionObject Detection

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
fail 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Residual Connection 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

OctFormer: Octree-based Transformers for 3D Point Clouds

2023-05-04 · Peng-Shuai Wang

We propose octree-based transformers, named OctFormer, for 3D point cloud learning. OctFormer can not only serve as a general and effective backbone for 3D point cloud segmentation and object detection but also have line…

3D Object Detection3D Semantic SegmentationGPUobject-detection+3

OctreeOcc: Efficient and Multi-Granularity Occupancy Prediction Using Octree Queries

2023-12-06 · Yuhang Lu, Xinge Zhu, Tai Wang, Yuexin Ma

Occupancy prediction has increasingly garnered attention in recent years for its fine-grained understanding of 3D scenes. Traditional approaches typically rely on dense, regular grid representations, which often leads to…

Prediction

BSH for Collision Detection in Point Cloud models

2024-07-04 · Mauro Figueiredo, João Pereira, João Oliveira, Bruno Araujo

Point cloud models are a common shape representation for several reasons. Three-dimensional scanning devices are widely used nowadays and points are an attractive primitive for rendering complex geometry. Nevertheless, t…

Open-Vocabulary Octree-Graph for 3D Scene Understanding

2024-11-25 · Zhigang Wang, Yifei Su, Chenhui Li, Dong Wang 외

Open-vocabulary 3D scene understanding is indispensable for embodied agents. Recent works leverage pretrained vision-language models (VLMs) for object segmentation and project them to point clouds to build 3D maps. Despi…

ObjectScene UnderstandingSemantic Segmentation

Efficient Autoregressive Shape Generation via Octree-Based Adaptive Tokenization

2025-04-03 · Kangle Deng, Hsueh-Ti Derek Liu, Yiheng Zhu, Xiaoxia Sun 외

Many 3D generative models rely on variational autoencoders (VAEs) to learn compact shape representations. However, existing methods encode all shapes into a fixed-size token, disregarding the inherent variations in scale…