paper-with-me

홈 › Papers

Towards Light Weight Object Detection System

2022-10-08 · Dharma KC, Venkata Ravi Kiran Dayana, Meng-Lin Wu, Venkateswara Rao Cherukuri, Hau Hwang

Transformers are a popular choice for classification tasks and as backbones for object detection tasks. However, their high latency brings challenges in their adaptation to lightweight object detection systems. We present an approximation of the self-attention layers used in the transformer architecture. This approximation reduces the latency of the classification system while incurring minimal loss in accuracy. We also present a method that uses a transformer encoder layer for multi-resolution feature fusion. This feature fusion improves the accuracy of the state-of-the-art lightweight object detection system without significantly increasing the number of parameters. Finally, we provide an abstraction for the transformer architecture called Generalized Transformer (gFormer) that can guide the design of novel transformer-like architectures.

📄 PDF Abstract BibTeX arXiv:2210.03861

Code (0)

등록된 구현이 없습니다.

Tasks

Objectobject-detectionObject Detection

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Position-Wise Feed-Forward Layer 설명 없음
Residual Connection 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Multi-Head Attention 설명 없음

Similar Papers 제목 키워드 기반

VINet: Lightweight, Scalable, and Heterogeneous Cooperative Perception for 3D Object Detection

2022-12-14 · Zhengwei Bai, Guoyuan Wu, Matthew J. Barth, Yongkang Liu 외

Utilizing the latest advances in Artificial Intelligence (AI), the computer vision community is now witnessing an unprecedented evolution in all kinds of perception tasks, particularly in object detection. Based on multi…

3D Object DetectionObjectobject-detectionObject Detection

HierLight-YOLO: A Hierarchical and Lightweight Object Detection Network for UAV Photography

2025-09-26 · Defan Chen, Yaohua Hu, Luchan Zhang arxiv

The real-time detection of small objects in complex scenes, such as the unmanned aerial vehicle (UAV) photography captured by drones, has dual challenges of detecting small targets (<32 pixels) and maintaining real-time …

Small Object Detection

CSL-YOLO: A New Lightweight Object Detection System for Edge Computing

2021-07-10 · Yu-Ming Zhang, Chun-Chieh Lee, Jun-Wei Hsieh, Kuo-Chin Fan

The development of lightweight object detectors is essential due to the limited computation resources. To reduce the computation cost, how to generate redundant features plays a significant role. This paper proposes a ne…

Edge-computingobject-detectionObject Detection

Towards High Performance Video Object Detection for Mobiles

2018-04-16 · Xizhou Zhu, Jifeng Dai, Xingchi Zhu, Yichen Wei 외

Despite the recent success of video object detection on Desktop GPUs, its architecture is still far too heavy for mobiles. It is also unclear whether the key principles of sparse feature propagation and multi-frame featu…

Objectobject-detectionObject DetectionVideo Object Detection+1

High-order Spatial Interactions Enhanced Lightweight Model for Optical Remote Sensing Image-based Small Ship Detection

2023-04-07 · Yifan Yin, Xu Cheng, Fan Shi, Xiufeng Liu 외

Accurate and reliable optical remote sensing image-based small-ship detection is crucial for maritime surveillance systems, but existing methods often struggle with balancing detection performance and computational compl…

object-detectionObject DetectionSmall Object Detection