Efficient ConvNet-based Object Detection for Unmanned Aerial Vehicles by Selective Tile Processing
Many applications utilizing Unmanned Aerial Vehicles (UAVs) require the use of computer vision algorithms to analyze the information captured from their on-board camera. Recent advances in deep learning have made it possible to use single-shot Convolutional Neural Network (CNN) detection algorithms that process the input image to detect various objects of interest. To keep the computational demands low these neural networks typically operate on small image sizes which, however, makes it difficult to detect small objects. This is further emphasized when considering UAVs equipped with cameras where due to the viewing range, objects tend to appear relatively small. This paper therefore, explores the trade-offs involved when maintaining the resolution of the objects of interest by extracting smaller patches (tiles) from the larger input image and processing them using a neural network. Specifically, we introduce an attention mechanism to focus on detecting objects only in some of the tiles and a memory mechanism to keep track of information for tiles that are not processed. Through the analysis of different methods and experiments we show that by carefully selecting which tiles to process we can considerably improve the detection accuracy while maintaining comparable performance to CNNs that resize and process a single image which makes the proposed approach suitable for UAV applications.
Code (1)
Tasks
object-detectionObject DetectionSimilar Papers 제목 키워드 기반
The Solution for the GAIIC2024 RGB-TIR object detection Challenge
This report introduces a solution to The task of RGB-TIR object detection from the perspective of unmanned aerial vehicles. Unlike traditional object detection methods, RGB-TIR object detection aims to utilize both RGB a…
Objectobject-detectionObject DetectionUAV3D: A Large-scale 3D Perception Benchmark for Unmanned Aerial Vehicles
Unmanned Aerial Vehicles (UAVs), equipped with cameras, are employed in numerous applications, including aerial photography, surveillance, and agriculture. In these applications, robust object detection and tracking are …
3D Object DetectionObjectobject-detectionObject Detection+2Leveraging Synthetic Data in Object Detection on Unmanned Aerial Vehicles
Acquiring data to train deep learning-based object detectors on Unmanned Aerial Vehicles (UAVs) is expensive, time-consuming and may even be prohibited by law in specific environments. On the other hand, synthetic data i…
Objectobject-detectionObject DetectionModel Agnostic Defense against Adversarial Patch Attacks on Object Detection in Unmanned Aerial Vehicles
Object detection forms a key component in Unmanned Aerial Vehicles (UAVs) for completing high-level tasks that depend on the awareness of objects on the ground from an aerial perspective. In that scenario, adversarial pa…
Objectobject-detectionObject DetectionStereo Vision for Unmanned Aerial VehicleDetection, Tracking, and Motion Control
An innovative method of detecting Unmanned Aerial Vehicles (UAVs) is presented. The goal of this study is to develop a robust setup for an autonomous multi-rotor hunter UAV, capable of visually detecting and tracking the…
Motion Planningobject-detectionObject Detection