paper-with-me

Papers

DETRs Beat YOLOs on Real-time Object Detection

2023-04-17 · CVPR 2024 1 · Yian Zhao, Wenyu Lv, Shangliang Xu, Jinman Wei, Guanzhong Wang, Qingqing Dang, Yi Liu, Jie Chen

The YOLO series has become the most popular framework for real-time object detection due to its reasonable trade-off between speed and accuracy. However, we observe that the speed and accuracy of YOLOs are negatively affected by the NMS. Recently, end-to-end Transformer-based detectors (DETRs) have provided an alternative to eliminating NMS. Nevertheless, the high computational cost limits their practicality and hinders them from fully exploiting the advantage of excluding NMS. In this paper, we propose the Real-Time DEtection TRansformer (RT-DETR), the first real-time end-to-end object detector to our best knowledge that addresses the above dilemma. We build RT-DETR in two steps, drawing on the advanced DETR: first we focus on maintaining accuracy while improving speed, followed by maintaining speed while improving accuracy. Specifically, we design an efficient hybrid encoder to expeditiously process multi-scale features by decoupling intra-scale interaction and cross-scale fusion to improve speed. Then, we propose the uncertainty-minimal query selection to provide high-quality initial queries to the decoder, thereby improving accuracy. In addition, RT-DETR supports flexible speed tuning by adjusting the number of decoder layers to adapt to various scenarios without retraining. Our RT-DETR-R50 / R101 achieves 53.1% / 54.3% AP on COCO and 108 / 74 FPS on T4 GPU, outperforming previously advanced YOLOs in both speed and accuracy. We also develop scaled RT-DETRs that outperform the lighter YOLO detectors (S and M models). Furthermore, RT-DETR-R50 outperforms DINO-R50 by 2.2% AP in accuracy and about 21 times in FPS. After pre-training with Objects365, RT-DETR-R50 / R101 achieves 55.3% / 56.2% AP. The project page: https://zhao-yian.github.io/RTDETR.

📄 PDF Abstract BibTeX arXiv:2304.08069

Code (9)

lyuwenyu/RT-DETR 공식 구현 paddle
MS-P3/code7/tree/main/yolos mindspore
MindSpore-scientific/code-7/tree/main/YOLOS
PaddlePaddle/PaddleDetection paddle
PaddlePaddle/PaddleYOLO paddle
huggingface/transformers pytorch
open-edge-platform/geti pytorch
open-edge-platform/training_extensions pytorch
ultralytics/ultralytics pytorch

Tasks

2D Object DetectionDecoderGPUObjectobject-detectionObject DetectionReal-Time Object Detection

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Position-Wise Feed-Forward Layer 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Residual Connection 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

RT-DETRv2: Improved Baseline with Bag-of-Freebies for Real-Time Detection Transformer

2024-07-24 · Wenyu Lv, Yian Zhao, Qinyao Chang, Kui Huang 외

In this report, we present RT-DETRv2, an improved Real-Time DEtection TRansformer (RT-DETR). RT-DETRv2 builds upon the previous state-of-the-art real-time detector, RT-DETR, and opens up a set of bag-of-freebies for flex…

Data AugmentationDecoder

YOLOv10: Real-Time End-to-End Object Detection

2024-05-23 · Ao Wang, Hui Chen, Lihao Liu, Kai Chen 외

Over the past years, YOLOs have emerged as the predominant paradigm in the field of real-time object detection owing to their effective balance between computational cost and detection performance. Researchers have explo…

2D Object DetectionData AugmentationObjectobject-detection+2

You Only Look at One Sequence: Rethinking Transformer in Vision through Object Detection

2021-06-01 · NeurIPS 2021 12 · Yuxin Fang, Bencheng Liao, Xinggang Wang, Jiemin Fang 외

Can Transformer perform 2D object- and region-level recognition from a pure sequence-to-sequence perspective with minimal knowledge about the 2D spatial structure? To answer this question, we present You Only Look at One…

Objectobject-detectionObject Detection

Human-in-the-loop Reasoning For Traffic Sign Detection: Collaborative Approach Yolo With Video-llava

2024-10-07 · Mehdi Azarafza, Fatima Idrees, Ali Ehteshami Bejnordi, Charles Steinmetz 외

Traffic Sign Recognition (TSR) detection is a crucial component of autonomous vehicles. While You Only Look Once (YOLO) is a popular real-time object detection algorithm, factors like training data quality and adverse we…

Autonomous Vehiclesobject-detectionObject DetectionReal-Time Object Detection+2

DETRDistill: A Universal Knowledge Distillation Framework for DETR-families

2022-11-17 · ICCV 2023 1 · Jiahao Chang, Shuo Wang, HaiMing Xu, Zehui Chen 외

Transformer-based detectors (DETRs) are becoming popular for their simple framework, but the large model size and heavy time consumption hinder their deployment in the real world. While knowledge distillation (KD) can be…

Knowledge Distillationobject-detectionObject Detection