Fast Event-based Optical Flow Estimation by Triplet Matching
Event cameras are novel bio-inspired sensors that offer advantages over traditional cameras (low latency, high dynamic range, low power, etc.). Optical flow estimation methods that work on packets of events trade off speed for accuracy, while event-by-event (incremental) methods have strong assumptions and have not been tested on common benchmarks that quantify progress in the field. Towards applications on resource-constrained devices, it is important to develop optical flow algorithms that are fast, light-weight and accurate. This work leverages insights from neuroscience, and proposes a novel optical flow estimation scheme based on triplet matching. The experiments on publicly available benchmarks demonstrate its capability to handle complex scenes with comparable results as prior packet-based algorithms. In addition, the proposed method achieves the fastest execution time (> 10 kHz) on standard CPUs as it requires only three events in estimation. We hope that our research opens the door to real-time, incremental motion estimation methods and applications in real-world scenarios.
Code (0)
등록된 구현이 없습니다.
Tasks
Event-based Optical FlowEvent-based visionMotion EstimationOptical Flow EstimationTripletMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
PCA Event-Based Optical Flow for Visual Odometry
With the advent of neuromorphic vision sensors such as event-based cameras, a paradigm shift is required for most computer vision algorithms. Among these algorithms, optical flow estimation is a prime candidate for this …
Event-based Optical FlowOptical Flow EstimationVisual OdometrySDformerFlow: Spatiotemporal swin spikeformer for event-based optical flow estimation
Event cameras generate asynchronous and sparse event streams capturing changes in light intensity. They offer significant advantages over conventional frame-based cameras, such as a higher dynamic range and an extremely …
Event-based Optical FlowOptical Flow EstimationVertical Landing for Micro Air Vehicles using Event-Based Optical Flow
Small flying robots can perform landing maneuvers using bio-inspired optical flow by maintaining a constant divergence. However, optical flow is typically estimated from frame sequences recorded by standard miniature cam…
Event-based Optical FlowOptical Flow EstimationvalidBlinkFlow: A Dataset to Push the Limits of Event-based Optical Flow Estimation
Event cameras provide high temporal precision, low data rates, and high dynamic range visual perception, which are well-suited for optical flow estimation. While data-driven optical flow estimation has obtained great suc…
Event-based Optical FlowOptical Flow EstimationEfficient Meshflow and Optical Flow Estimation from Event Cameras
In this paper we explore the problem of event-based meshflow estimation a novel task that involves predicting a spatially smooth sparse motion field from event cameras. To start we generate a large-scale High-Resolut…
DecoderOptical Flow Estimation