Deep Learning-based Human Detection for UAVs with Optical and Infrared Cameras: System and Experiments
In this paper, we present our deep learning-based human detection system that uses optical (RGB) and long-wave infrared (LWIR) cameras to detect, track, localize, and re-identify humans from UAVs flying at high altitude. In each spectrum, a customized RetinaNet network with ResNet backbone provides human detections which are subsequently fused to minimize the overall false detection rate. We show that by optimizing the bounding box anchors and augmenting the image resolution the number of missed detections from high altitudes can be decreased by over 20 percent. Our proposed network is compared to different RetinaNet and YOLO variants, and to a classical optical-infrared human detection framework that uses hand-crafted features. Furthermore, along with the publication of this paper, we release a collection of annotated optical-infrared datasets recorded with different UAVs during search-and-rescue field tests and the source code of the implemented annotation tool.
Code (0)
등록된 구현이 없습니다.
Tasks
Human DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Fusion Flow-enhanced Graph Pooling Residual Networks for Unmanned Aerial Vehicles Surveillance in Day and Night Dual Visions
Recognizing unauthorized Unmanned Aerial Vehicles (UAVs) within designated no-fly zones throughout the day and night is of paramount importance, where the unauthorized UAVs pose a substantial threat to both civil and mil…
Graph Neural NetworkOptical Flow EstimationReal Time Human Detection by Unmanned Aerial Vehicles
One of the most important problems in computer vision and remote sensing is object detection, which identifies particular categories of diverse things in pictures. Two crucial data sources for public security are the the…
Human DetectionObjectobject-detectionObject DetectionDecisive Data using Multi-Modality Optical Sensors for Advanced Vehicular Systems
Optical sensors have played a pivotal role in acquiring real world data for critical applications. This data, when integrated with advanced machine learning algorithms provides meaningful information thus enhancing human…
TF-Net: Deep Learning Empowered Tiny Feature Network for Night-time UAV Detection
Technological advancements have normalized the usage of unmanned aerial vehicles (UAVs) in every sector, spanning from military to commercial but they also pose serious security concerns due to their enhanced functionali…
BatMobility: Towards Flying Without Seeing for Autonomous Drones
Unmanned aerial vehicles (UAVs) rely on optical sensors such as cameras and lidar for autonomous operation. However, such optical sensors are error-prone in bad lighting, inclement weather conditions including fog and sm…
Collision AvoidanceOptical Flow Estimation