paper-with-me

홈 › Papers

Neuromorphic Drone Detection: an Event-RGB Multimodal Approach

2024-09-24 · Gabriele Magrini, Federico Becattini, Pietro Pala, Alberto del Bimbo, Antonio Porta

In recent years, drone detection has quickly become a subject of extreme interest: the potential for fast-moving objects of contained dimensions to be used for malicious intents or even terrorist attacks has posed attention to the necessity for precise and resilient systems for detecting and identifying such elements. While extensive literature and works exist on object detection based on RGB data, it is also critical to recognize the limits of such modality when applied to UAVs detection. Detecting drones indeed poses several challenges such as fast-moving objects and scenes with a high dynamic range or, even worse, scarce illumination levels. Neuromorphic cameras, on the other hand, can retain precise and rich spatio-temporal information in situations that are challenging for RGB cameras. They are resilient to both high-speed moving objects and scarce illumination settings, while prone to suffer a rapid loss of information when the objects in the scene are static. In this context, we present a novel model for integrating both domains together, leveraging multimodal data to take advantage of the best of both worlds. To this end, we also release NeRDD (Neuromorphic-RGB Drone Detection), a novel spatio-temporally synchronized Event-RGB Drone detection dataset of more than 3.5 hours of multimodal annotated recordings.

📄 PDF Abstract BibTeX arXiv:2409.16099

Code (1)

magrinigabriele/nerdd 공식 구현

Tasks

object-detectionObject Detection

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

Drone Detection Using a Low-Power Neuromorphic Virtual Tripwire

2025-09-16 · Anton Eldeborg Lundin, Rasmus Winzell, Hanna Hamrell, David Gustafsson 외 arxiv

Small drones are an increasing threat to both military personnel and civilian infrastructure, making early and automated detection crucial. In this work we develop a system that uses spiking neural networks and neuromorp…

Fully neuromorphic vision and control for autonomous drone flight

2023-03-15 · Federico Paredes-Vallés, Jesse Hagenaars, Julien Dupeyroux, Stein Stroobants 외

Biological sensing and processing is asynchronous and sparse, leading to low-latency and energy-efficient perception and action. In robotics, neuromorphic hardware for event-based vision and spiking neural networks promi…

Event-based visionSelf-Supervised Learning

FRED: The Florence RGB-Event Drone Dataset

2025-06-05 · Gabriele Magrini, Niccolò Marini, Federico Becattini, Lorenzo Berlincioni 외

Small, fast, and lightweight drones present significant challenges for traditional RGB cameras due to their limitations in capturing fast-moving objects, especially under challenging lighting conditions. Event cameras of…

BenchmarkingTrajectory Forecasting

No Dense Tensors Needed: Fully Sparse Object Detection on Event-Camera Voxel Grids

2026-03-23 · Mohamad Yazan Sadoun, Sarah Sharif, Yaser Mike Banad arxiv

Event cameras produce asynchronous, high-dynamic-range streams well suited for detecting small, fast-moving drones, yet most event-based detectors convert the sparse event stream into dense tensors, discarding the repres…

Object Detection

Event-driven Vision and Control for UAVs on a Neuromorphic Chip

2021-08-08 · Antonio Vitale, Alpha Renner, Celine Nauer, Davide Scaramuzza 외

Event-based vision sensors achieve up to three orders of magnitude better speed vs. power consumption trade off in high-speed control of UAVs compared to conventional image sensors. Event-based cameras produce a sparse s…

Drone ControllerEvent-based vision