paper-with-me

홈 › Papers

Oriented Object Detection with Transformer

2021-06-06 · Teli Ma, Mingyuan Mao, Honghui Zheng, Peng Gao, Xiaodi Wang, Shumin Han, Errui Ding, Baochang Zhang, David Doermann

Object detection with Transformers (DETR) has achieved a competitive performance over traditional detectors, such as Faster R-CNN. However, the potential of DETR remains largely unexplored for the more challenging task of arbitrary-oriented object detection problem. We provide the first attempt and implement Oriented Object DEtection with TRansformer ($\bf O^2DETR$) based on an end-to-end network. The contributions of $\rm O^2DETR$ include: 1) we provide a new insight into oriented object detection, by applying Transformer to directly and efficiently localize objects without a tedious process of rotated anchors as in conventional detectors; 2) we design a simple but highly efficient encoder for Transformer by replacing the attention mechanism with depthwise separable convolution, which can significantly reduce the memory and computational cost of using multi-scale features in the original Transformer; 3) our $\rm O^2DETR$ can be another new benchmark in the field of oriented object detection, which achieves up to 3.85 mAP improvement over Faster R-CNN and RetinaNet. We simply fine-tune the head mounted on $\rm O^2DETR$ in a cascaded architecture and achieve a competitive performance over SOTA in the DOTA dataset.

📄 PDF Abstract BibTeX arXiv:2106.03146

Code (0)

등록된 구현이 없습니다.

Tasks

Objectobject-detectionObject DetectionOriented Object Detection

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
FPN 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Similar Papers 제목 키워드 기반

Learning RoI Transformer for Oriented Object Detection in Aerial Images

2019-06-01 · CVPR 2019 6 · Jian Ding, Nan Xue, Yang Long, Gui-Song Xia 외

Object detection in aerial images is an active yet challenging task in computer vision because of the bird's-eye view perspective, the highly complex backgrounds, and the variant appearances of objects. Especially when d…

Objectobject-detectionObject DetectionObject Detection In Aerial Images+1

AO2-DETR: Arbitrary-Oriented Object Detection Transformer

2022-05-25 · Linhui Dai, Hong Liu, Hao Tang, Zhiwei Wu 외

Arbitrary-oriented object detection (AOOD) is a challenging task to detect objects in the wild with arbitrary orientations and cluttered arrangements. Existing approaches are mainly based on anchor-based boxes or dense p…

DecoderInductive BiasObjectobject-detection+3

ARS-DETR: Aspect Ratio-Sensitive Detection Transformer for Aerial Oriented Object Detection

2023-03-09 · Ying Zeng, Yushi Chen, Xue Yang, Qingyun Li 외

Existing oriented object detection methods commonly use metric AP$_{50}$ to measure the performance of the model. We argue that AP$_{50}$ is inherently unsuitable for oriented object detection due to its large tolerance …

Objectobject-detectionObject DetectionOriented Object Detection

OrientedFormer: An End-to-End Transformer-Based Oriented Object Detector in Remote Sensing Images

2024-09-29 · IEEE Transactions on Geoscience and Remote Sensing 2024 9 · Jiaqi Zhao, Zeyu Ding, Yong Zhou, Hancheng Zhu 외

Oriented object detection in remote sensing images is a challenging task due to objects being distributed in multi-orientation. Recently, end-to-end transformer-based methods have achieved success by eliminating the need…

object-detectionObject DetectionOriented Object DetectionPosition

RotaTR: Detection Transformer for Dense and Rotated Object

2023-12-05 · Zhu Yuke, Ruan Yumeng, Yang Lei, Guo Sheng

Detecting the objects in dense and rotated scenes is a challenging task. Recent works on this topic are mostly based on Faster RCNN or Retinanet. As they are highly dependent on the pre-set dense anchors and the NMS oper…

Action RecognitionDecoderObjectobject-detection+1