paper-with-me

홈 › Papers

Aerial Image Object Detection With Vision Transformer Detector (ViTDet)

2023-01-28 · Liya Wang, Alex Tien

The past few years have seen an increased interest in aerial image object detection due to its critical value to large-scale geo-scientific research like environmental studies, urban planning, and intelligence monitoring. However, the task is very challenging due to the birds-eye view perspective, complex backgrounds, large and various image sizes, different appearances of objects, and the scarcity of well-annotated datasets. Recent advances in computer vision have shown promise tackling the challenge. Specifically, Vision Transformer Detector (ViTDet) was proposed to extract multi-scale features for object detection. The empirical study shows that ViTDet's simple design achieves good performance on natural scene images and can be easily embedded into any detector architecture. To date, ViTDet's potential benefit to challenging aerial image object detection has not been explored. Therefore, in our study, 25 experiments were carried out to evaluate the effectiveness of ViTDet for aerial image object detection on three well-known datasets: Airbus Aircraft, RarePlanes, and Dataset of Object DeTection in Aerial images (DOTA). Our results show that ViTDet can consistently outperform its convolutional neural network counterparts on horizontal bounding box (HBB) object detection by a large margin (up to 17% on average precision) and that it achieves the competitive performance for oriented bounding box (OBB) object detection. Our results also establish a baseline for future research.

📄 PDF Abstract BibTeX arXiv:2301.12058

Code (1)

MS-P3/code7/tree/main/vitdet mindspore

Tasks

Objectobject-detectionObject DetectionObject Detection In Aerial Images

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Adam 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

Learning RoI Transformer for Oriented Object Detection in Aerial Images

2019-06-01 · CVPR 2019 6 · Jian Ding, Nan Xue, Yang Long, Gui-Song Xia 외

Object detection in aerial images is an active yet challenging task in computer vision because of the bird's-eye view perspective, the highly complex backgrounds, and the variant appearances of objects. Especially when d…

Objectobject-detectionObject DetectionObject Detection In Aerial Images+1

SOAR: Advancements in Small Body Object Detection for Aerial Imagery Using State Space Models and Programmable Gradients

2024-05-02 · Tushar Verma, Jyotsna Singh, Yash Bhartari, Rishi Jarwal 외

Small object detection in aerial imagery presents significant challenges in computer vision due to the minimal data inherent in small-sized objects and their propensity to be obscured by larger objects and background noi…

image-classificationImage ClassificationMambaobject-detection+5

Learning RoI Transformer for Detecting Oriented Objects in Aerial Images

2018-12-01 · Jian Ding, Nan Xue, Yang Long, Gui-Song Xia 외

Object detection in aerial images is an active yet challenging task in computer vision because of the birdview perspective, the highly complex backgrounds, and the variant appearances of objects. Especially when detectin…

General ClassificationObjectobject-detectionObject Detection+3

DOTA: A Large-scale Dataset for Object Detection in Aerial Images

2017-11-28 · CVPR 2018 6 · Gui-Song Xia, Xiang Bai, Jian Ding, Zhen Zhu 외

Object detection is an important and challenging problem in computer vision. Although the past decade has witnessed major advances in object detection in natural scenes, such successes have been slow to aerial imagery, n…

Earth ObservationObjectobject-detectionObject Detection+1

An Empirical Study of Remote Sensing Pretraining

2022-04-06 · Di Wang, Jing Zhang, Bo Du, Gui-Song Xia 외

Deep learning has largely reshaped remote sensing (RS) research for aerial image understanding and made a great success. Nevertheless, most of the existing deep models are initialized with the ImageNet pretrained weights…

Aerial Scene ClassificationBuilding change detection for remote sensing imagesChange DetectionChange detection for remote sensing images+4