A Unifying Contrast Maximization Framework for Event Cameras, with Applications to Motion, Depth, and Optical Flow Estimation
We present a unifying framework to solve several computer vision problems with event cameras: motion, depth and optical flow estimation. The main idea of our framework is to find the point trajectories on the image plane that are best aligned with the event data by maximizing an objective function: the contrast of an image of warped events. Our method implicitly handles data association between the events, and therefore, does not rely on additional appearance information about the scene. In addition to accurately recovering the motion parameters of the problem, our framework produces motion-corrected edge-like images with high dynamic range that can be used for further scene analysis. The proposed method is not only simple, but more importantly, it is, to the best of our knowledge, the first method that can be successfully applied to such a diverse set of important vision tasks with event cameras.
Code (2)
Tasks
Optical Flow EstimationSimilar Papers 제목 키워드 기반
Event Cameras, Contrast Maximization and Reward Functions: An Analysis
Event cameras asynchronously report timestamped changes in pixel intensity and offer advantages over conventional raster scan cameras in terms of low-latency, low redundancy sensing and high dynamic range. In recent year…
Event-based visionOptical Flow EstimationSemantic SegmentationA Fast Geometric Regularizer to Mitigate Event Collapse in the Contrast Maximization Framework
Event cameras are emerging vision sensors and their advantages are suitable for various applications such as autonomous robots. Contrast maximization (CMax), which provides state-of-the-art accuracy on motion estimation …
Event-based Motion EstimationEvent-based visionMotion EstimationIterative Event-based Motion Segmentation by Variational Contrast Maximization
Event cameras provide rich signals that are suitable for motion estimation since they respond to changes in the scene. As any visual changes in the scene produce event data, it is paramount to classify the data into diff…
Motion EstimationMotion SegmentationMoving Object Detectionobject-detection+2Motion-prior Contrast Maximization for Dense Continuous-Time Motion Estimation
Current optical flow and point-tracking methods rely heavily on synthetic datasets. Event cameras are novel vision sensors with advantages in challenging visual conditions, but state-of-the-art frame-based methods cannot…
Motion EstimationOptical Flow EstimationPoint TrackingSecrets of Edge-Informed Contrast Maximization for Event-Based Vision
Event cameras capture the motion of intensity gradients (edges) in the image plane in the form of rapid asynchronous events. When accumulated in 2D histograms, these events depict overlays of the edges in motion, consequ…
Event-based visionOptical Flow Estimation