paper-with-me

Papers

Event-based vision on FPGAs -- a survey

2024-07-11 · Tomasz Kryjak

In recent years there has been a growing interest in event cameras, i.e. vision sensors that record changes in illumination independently for each pixel. This type of operation ensures that acquisition is possible in very adverse lighting conditions, both in low light and high dynamic range, and reduces average power consumption. In addition, the independent operation of each pixel results in low latency, which is desirable for robotic solutions. Nowadays, Field Programmable Gate Arrays (FPGAs), along with general-purpose processors (GPPs/CPUs) and programmable graphics processing units (GPUs), are popular architectures for implementing and accelerating computing tasks. In particular, their usefulness in the embedded vision domain has been repeatedly demonstrated over the past 30 years, where they have enabled fast data processing (even in real-time) and energy efficiency. Hence, the combination of event cameras and reconfigurable devices seems to be a good solution, especially in the context of energy-efficient real-time embedded systems. This paper gives an overview of the most important works, where FPGAs have been used in different contexts to process event data. It covers applications in the following areas: filtering, stereovision, optical flow, acceleration of AI-based algorithms (including spiking neural networks) for object classification, detection and tracking, and applications in robotics and inspection systems. Current trends and challenges for such systems are also discussed.

📄 PDF Abstract BibTeX arXiv:2407.08356

Code (0)

등록된 구현이 없습니다.

Tasks

Event-based visionOptical Flow EstimationSurvey

Similar Papers 제목 키워드 기반

Accelerating CNN inference on FPGAs: A Survey

2018-05-26 · Kamel Abdelouahab, Maxime Pelcat, Jocelyn Serot, François Berry

Convolutional Neural Networks (CNNs) are currently adopted to solve an ever greater number of problems, ranging from speech recognition to image classification and segmentation. The large amount of processing required by…

Diversityimage-classificationImage Classificationspeech-recognition+2

Toolflows for Mapping Convolutional Neural Networks on FPGAs: A Survey and Future Directions

2018-03-15 · Stylianos I. Venieris, Alexandros Kouris, Christos-Savvas Bouganis

In the past decade, Convolutional Neural Networks (CNNs) have demonstrated state-of-the-art performance in various Artificial Intelligence tasks. To accelerate the experimentation and development of CNNs, several softwar…

Embedded Graph Convolutional Networks for Real-Time Event Data Processing on SoC FPGAs

2024-06-11 · Kamil Jeziorek, Piotr Wzorek, Krzysztof Blachut, Andrea Pinna 외

The utilisation of event cameras represents an important and swiftly evolving trend aimed at addressing the constraints of traditional video systems. Particularly within the automotive domain, these cameras find signific…

Optimising Graph Representation for Hardware Implementation of Graph Convolutional Networks for Event-based Vision

2024-01-10 · Kamil Jeziorek, Piotr Wzorek, Krzysztof Blachut, Andrea Pinna 외

Event-based vision is an emerging research field involving processing data generated by Dynamic Vision Sensors (neuromorphic cameras). One of the latest proposals in this area are Graph Convolutional Networks (GCNs), whi…

Event-based visionGraph Generationobject-detectionObject Detection

FPGA-Enabled Machine Learning Applications in Earth Observation: A Systematic Review

2025-06-04 · Cédric Léonard, Dirk Stober, Martin Schulz

New UAV technologies and the NewSpace era are transforming Earth Observation missions and data acquisition. Numerous small platforms generate large data volume, straining bandwidth and requiring onboard decision-making t…

Decision MakingEarth Observation