Pyramid Transformer for Traffic Sign Detection

2022-07-13 · Omid Nejati Manzari, Amin Boudesh, Shahriar B. Shokouhi

Traffic sign detection is a vital task in the visual system of self-driving cars and the automated driving system. Recently, novel Transformer-based models have achieved encouraging results for various computer vision tasks. We still observed that vanilla ViT could not yield satisfactory results in traffic sign detection because the overall size of the datasets is very small and the class distribution of traffic signs is extremely unbalanced. To overcome this problem, a novel Pyramid Transformer with locality mechanisms is proposed in this paper. Specifically, Pyramid Transformer has several spatial pyramid reduction layers to shrink and embed the input image into tokens with rich multi-scale context by using atrous convolutions. Moreover, it inherits an intrinsic scale invariance inductive bias and is able to learn local feature representation for objects at various scales, thereby enhancing the network robustness against the size discrepancy of traffic signs. The experiments are conducted on the German Traffic Sign Detection Benchmark (GTSDB). The results demonstrate the superiority of the proposed model in the traffic sign detection tasks. More specifically, Pyramid Transformer achieves 77.8% mAP on GTSDB when applied to the Cascade RCNN as the backbone, which surpasses most well-known and widely-used state-of-the-art models.

📄 PDF Abstract BibTeX arXiv:2207.06067

Code (0)

등록된 구현이 없습니다.

Tasks

Inductive BiasSelf-Driving CarsTraffic Sign Detection

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음

Attention 설명 없음

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Improved YOLOv5 network for real-time multi-scale traffic sign detection

2021-12-16 · Junfan Wang, Yi Chen, Mingyu Gao, Zhekang Dong

Traffic sign detection is a challenging task for the unmanned driving system, especially for the detection of multi-scale targets and the real-time problem of detection. In the traffic sign detection process, the scale o…

Data Augmentation Traffic Sign Detection

Extended Feature Pyramid Network for Small Object Detection

2020-03-16 · Chunfang Deng, Mengmeng Wang, Liang Liu, Yong liu

Small object detection remains an unsolved challenge because it is hard to extract information of small objects with only a few pixels. While scale-level corresponding detection in feature pyramid network alleviates this…

Object object-detection Object Detection Small Object Detection

Peri-midFormer: Periodic Pyramid Transformer for Time Series Analysis

2024-11-07 · Qiang Wu, Gechang Yao, Zhixi Feng, Shuyuan Yang

Time series analysis finds wide applications in fields such as weather forecasting, anomaly detection, and behavior recognition. Previous methods attempted to model temporal variations directly using 1D time series. Howe…

Anomaly Detection Classification Imputation Time Series+3

RePFormer: Refinement Pyramid Transformer for Robust Facial Landmark Detection

2022-07-08 · Jinpeng Li, Haibo Jin, Shengcai Liao, Ling Shao 외

This paper presents a Refinement Pyramid Transformer (RePFormer) for robust facial landmark detection. Most facial landmark detectors focus on learning representative image features. However, these CNN-based feature repr…

Facial Landmark Detection

Explainable Graph Pyramid Autoformer for Long-Term Traffic Forecasting

2022-09-27 · Weiheng Zhong, Tanwi Mallick, Hadi Meidani, Jane Macfarlane 외

Accurate traffic forecasting is vital to an intelligent transportation system. Although many deep learning models have achieved state-of-art performance for short-term traffic forecasting of up to 1 hour, long-term traff…

Graph Neural Network Temporal Sequences