paper-with-me

홈 › Papers

Common Corruptions for Enhancing and Evaluating Robustness in Air-to-Air Visual Object Detection

2024-05-10 · Anastasios Arsenos, Vasileios Karampinis, Evangelos Petrongonas, Christos Skliros, Dimitrios Kollias, Stefanos Kollias, Athanasios Voulodimos

The main barrier to achieving fully autonomous flights lies in autonomous aircraft navigation. Managing non-cooperative traffic presents the most important challenge in this problem. The most efficient strategy for handling non-cooperative traffic is based on monocular video processing through deep learning models. This study contributes to the vision-based deep learning aircraft detection and tracking literature by investigating the impact of data corruption arising from environmental and hardware conditions on the effectiveness of these methods. More specifically, we designed $7$ types of common corruptions for camera inputs taking into account real-world flight conditions. By applying these corruptions to the Airborne Object Tracking (AOT) dataset we constructed the first robustness benchmark dataset named AOT-C for air-to-air aerial object detection. The corruptions included in this dataset cover a wide range of challenging conditions such as adverse weather and sensor noise. The second main contribution of this letter is to present an extensive experimental evaluation involving $8$ diverse object detectors to explore the degradation in the performance under escalating levels of corruptions (domain shifts). Based on the evaluation results, the key observations that emerge are the following: 1) One-stage detectors of the YOLO family demonstrate better robustness, 2) Transformer-based and multi-stage detectors like Faster R-CNN are extremely vulnerable to corruptions, 3) Robustness against corruptions is related to the generalization ability of models. The third main contribution is to present that finetuning on our augmented synthetic data results in improvements in the generalisation ability of the object detector in real-world flight experiments.

📄 PDF Abstract BibTeX arXiv:2405.06765

Code (0)

등록된 구현이 없습니다.

Tasks

Objectobject-detectionObject DetectionObject Tracking

Methods 이 논문이 사용한 방법론

RoIPool 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
RPN A Region Proposal Network, or RPN, is a fully convolutional network that simultaneously predicts object bounds and objectness scores at each position. The RPN is trained…
Faster R-CNN Faster R-CNN is an object detection model that improves on Fast R-CNN by utilising a region proposal network…

Similar Papers 제목 키워드 기반

Benchmarking the Robustness of UAV Tracking Against Common Corruptions

2024-03-18 · Xiaoqiong Liu, Yunhe Feng, Shu Hu, Xiaohui Yuan 외

The robustness of unmanned aerial vehicle (UAV) tracking is crucial in many tasks like surveillance and robotics. Despite its importance, little attention is paid to the performance of UAV trackers under common corruptio…

Benchmarking

Enhancing Robustness of CLIP to Common Corruptions through Bimodal Test-Time Adaptation

2024-12-03 · Sarthak Kumar Maharana, Baoming Zhang, Leonid Karlinsky, Rogerio Feris 외

Although open-vocabulary classification models like Contrastive Language Image Pretraining (CLIP) have demonstrated strong zero-shot learning capabilities, their robustness to common image corruptions remains poorly unde…

Test-time AdaptationZero-Shot Learning

Towards Evaluating the Robustness of Visual State Space Models

2024-06-13 · Hashmat Shadab Malik, Fahad Shamshad, Muzammal Naseer, Karthik Nandakumar 외

Vision State Space Models (VSSMs), a novel architecture that combines the strengths of recurrent neural networks and latent variable models, have demonstrated remarkable performance in visual perception tasks by efficien…

Adversarial Robustnessobject-detectionObject DetectionState Space Models

Exploring the Robustness of Human Parsers Towards Common Corruptions

2023-09-02 · Sanyi Zhang, Xiaochun Cao, Rui Wang, Guo-Jun Qi 외

Human parsing aims to segment each pixel of the human image with fine-grained semantic categories. However, current human parsers trained with clean data are easily confused by numerous image corruptions such as blur and…

Data AugmentationDiversityHuman ParsingSemantic Segmentation

Analysing the Robustness of Vision-Language-Models to Common Corruptions

2025-04-18 · Muhammad Usama, Syeda Aishah Asim, Syed Bilal Ali, Syed Talal Wasim 외

Vision-language models (VLMs) have demonstrated impressive capabilities in understanding and reasoning about visual and textual content. However, their robustness to common image corruptions remains under-explored. In th…

TextVQA