paper-with-me

홈 › Papers

Embracing Single Stride 3D Object Detector with Sparse Transformer

2021-12-13 · CVPR 2022 1 · Lue Fan, Ziqi Pang, Tianyuan Zhang, Yu-Xiong Wang, Hang Zhao, Feng Wang, Naiyan Wang, Zhaoxiang Zhang

In LiDAR-based 3D object detection for autonomous driving, the ratio of the object size to input scene size is significantly smaller compared to 2D detection cases. Overlooking this difference, many 3D detectors directly follow the common practice of 2D detectors, which downsample the feature maps even after quantizing the point clouds. In this paper, we start by rethinking how such multi-stride stereotype affects the LiDAR-based 3D object detectors. Our experiments point out that the downsampling operations bring few advantages, and lead to inevitable information loss. To remedy this issue, we propose Single-stride Sparse Transformer (SST) to maintain the original resolution from the beginning to the end of the network. Armed with transformers, our method addresses the problem of insufficient receptive field in single-stride architectures. It also cooperates well with the sparsity of point clouds and naturally avoids expensive computation. Eventually, our SST achieves state-of-the-art results on the large scale Waymo Open Dataset. It is worth mentioning that our method can achieve exciting performance (83.8 LEVEL 1 AP on validation split) on small object (pedestrian) detection due to the characteristic of single stride. Codes will be released at https://github.com/TuSimple/SST

📄 PDF Abstract BibTeX arXiv:2112.06375

Code (2)

tusimple/sst 공식 구현 pytorch
tusen-ai/sst pytorch

Tasks

3D Object DetectionAutonomous DrivingObjectobject-detectionObject DetectionPedestrian Detection

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Cosine Annealing Cosine Annealing is a type of learning rate schedule that has the effect of starting with a large learning rate that is relatively rapidly decreased to a minimum value before…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

PillarNeSt: Embracing Backbone Scaling and Pretraining for Pillar-based 3D Object Detection

2023-11-29 · Weixin Mao, Tiancai Wang, Diankun Zhang, Junjie Yan 외

This paper shows the effectiveness of 2D backbone scaling and pretraining for pillar-based 3D object detectors. Pillar-based methods mainly employ randomly initialized 2D convolution neural network (ConvNet) for feature …

3D Object Detectionobject-detectionObject Detection

Anchor-free 3D Single Stage Detector with Mask-Guided Attention for Point Cloud

2021-08-08 · Jiale Li, Hang Dai, Ling Shao, Yong Ding

Most of the existing single-stage and two-stage 3D object detectors are anchor-based methods, while the efficient but challenging anchor-free single-stage 3D object detection is not well investigated. Recent studies on 2…

2D Object Detection3D Object DetectionObjectobject-detection+1

Shape-Prior-Based Point Cloud Completion for Single-Stage Fully Sparse 3D Object Detection

2026-05-30 · Kaizheng Wang, Mingqian Ji, Jian Yang, Shanshan Zhang arxiv

Single-stage fully sparse 3D object detectors rely on point clouds data to detect objects in autonomous driving scenarios. However, the sparsity and incompleteness of point clouds significantly limit the performance of 3…

Point Cloud Completion3D Object DetectionAutonomous DrivingPoint Clouds

Progressive Sparse Local Attention for Video object detection

2019-03-21 · ICCV 2019 10 · Chaoxu Guo, Bin Fan, Jie Gu, Qian Zhang 외

Transferring image-based object detectors to the domain of videos remains a challenging problem. Previous efforts mostly exploit optical flow to propagate features across frames, aiming to achieve a good trade-off betwee…

Objectobject-detectionObject DetectionOptical Flow Estimation+1

Semi-Supervised Object Detection with Sparsely Annotated Dataset

2020-06-21 · Jihun Yoon, Seungbum Hong, Sanha Jeong, Min-Kook Choi

In training object detector based on convolutional neural networks, selection of effective positive examples for training is an important factor. However, when training an anchor-based detectors with sparse annotations o…

Objectobject-detectionObject DetectionObject Tracking+1