Graph-based Asynchronous Event Processing for Rapid Object Recognition
Different from traditional video cameras, event cameras capture asynchronous events stream in which each event encodes pixel location, trigger time, and the polarity of the brightness changes. In this paper, we introduce a novel graph-based framework for event cameras, namely SlideGCN. Unlike some recent graph-based methods that use groups of events as input, our approach can efficiently process data event-by-event, unlock the low latency nature of events data while still maintaining the graph's structure internally. For fast graph construction, we develop a radius search algorithm, which better exploits the partial regular structure of event cloud against k-d tree based generic methods. Experiments show that our method reduces the computational complexity up to 100 times with respect to current graph-based methods while keeping state-of-the-art performance on object recognition. Moreover, we verify the superiority of event-wise processing with our method. When the state becomes stable, we can give a prediction with high confidence, thus making an early recognition. Project page: \url{https://zju3dv.github.io/slide_gcn/}.
Code (0)
등록된 구현이 없습니다.
Tasks
graph constructionObject RecognitionSimilar Papers 제목 키워드 기반
AEGNN: Asynchronous Event-based Graph Neural Networks
The best performing learning algorithms devised for event cameras work by first converting events into dense representations that are then processed using standard CNNs. However, these steps discard both the sparsity and…
Asynchronous Collaborative Graph Representation for Frames and Events
Integrating frames and events has become a widely accepted solution for various tasks in challenging scenarios. However, most multimodal methods directly convert events into image-like formats synchronized with frame…
Depth EstimationDomain Adaptationobject-detectionObject DetectionAsynchronous Multi-Object Tracking with an Event Camera
Events cameras are ideal sensors for enabling robots to detect and track objects in highly dynamic environments due to their low latency output, high temporal resolution, and high dynamic range. In this paper, we present…
Multi-Object TrackingObjectObject TrackingOptical Flow EstimationGraph Neural Network Combining Event Stream and Periodic Aggregation for Low-Latency Event-based Vision
Event-based cameras asynchronously detect changes in light intensity with high temporal resolution, making them a promising alternative to RGB camera for low-latency and low-power optical flow estimation. However, st…
Event-based visionGraph Neural NetworkOptical Flow EstimationPushing the Limits of Asynchronous Graph-based Object Detection with Event Cameras
State-of-the-art machine-learning methods for event cameras treat events as dense representations and process them with conventional deep neural networks. Thus, they fail to maintain the sparsity and asynchronous nature …
Graph Neural Networkobject-detectionObject Detection