Deep Learning Computer Vision Algorithms for Real-time UAVs On-board Camera Image Processing
This paper describes how advanced deep learning based computer vision algorithms are applied to enable real-time on-board sensor processing for small UAVs. Four use cases are considered: target detection, classification and localization, road segmentation for autonomous navigation in GNSS-denied zones, human body segmentation, and human action recognition. All algorithms have been developed using state-of-the-art image processing methods based on deep neural networks. Acquisition campaigns have been carried out to collect custom datasets reflecting typical operational scenarios, where the peculiar point of view of a multi-rotor UAV is replicated. Algorithms architectures and trained models performances are reported, showing high levels of both accuracy and inference speed. Output examples and on-field videos are presented, demonstrating models operation when deployed on a GPU-powered commercial embedded device (NVIDIA Jetson Xavier) mounted on board of a custom quad-rotor, paving the way to enabling high level autonomy.
Code (0)
등록된 구현이 없습니다.
Tasks
Action RecognitionAutonomous NavigationGPURoad SegmentationSegmentationTemporal Action LocalizationSimilar Papers 제목 키워드 기반
A Compendium of Autonomous Navigation using Object Detection and Tracking in Unmanned Aerial Vehicles
Unmanned Aerial Vehicles (UAVs) are one of the most revolutionary inventions of 21st century. At the core of a UAV lies the central processing system that uses wireless signals to control their movement. The most popular…
Autonomous Navigationobject-detectionObject DetectionSeaDroneSim: Simulation of Aerial Images for Detection of Objects Above Water
Unmanned Aerial Vehicles (UAVs) are known for their fast and versatile applicability. With UAVs' growth in availability and applications, they are now of vital importance in serving as technological support in search-and…
Stereo Vision for Unmanned Aerial VehicleDetection, Tracking, and Motion Control
An innovative method of detecting Unmanned Aerial Vehicles (UAVs) is presented. The goal of this study is to develop a robust setup for an autonomous multi-rotor hunter UAV, capable of visually detecting and tracking the…
Motion Planningobject-detectionObject DetectionAU-AIR: A Multi-modal Unmanned Aerial Vehicle Dataset for Low Altitude Traffic Surveillance
Unmanned aerial vehicles (UAVs) with mounted cameras have the advantage of capturing aerial (bird-view) images. The availability of aerial visual data and the recent advances in object detection algorithms led the comput…
Objectobject-detectionObject DetectionReal-Time Object DetectionSeaDronesSee: A Maritime Benchmark for Detecting Humans in Open Water
Unmanned Aerial Vehicles (UAVs) are of crucial importance in search and rescue missions in maritime environments due to their flexible and fast operation capabilities. Modern computer vision algorithms are of great inter…
Multi-Object Trackingobject-detectionObject DetectionObject Tracking