Event-Intensity Stereo: Estimating Depth by the Best of Both Worlds
Event cameras can report scene movements as an asynchronous stream of data called the events. Unlike traditional cameras, event cameras have very low latency (microseconds vs milliseconds) very high dynamic range (140dB vs 60 dB), and low power consumption, as they report changes of a scene and not a complete frame. As they re-port per pixel feature-like events and not the whole intensity frame they are immune to motion blur. However, event cameras require movement between the scene and camera to fire events ,i.e., they have no output when the scene is relatively static. Traditional cameras, however, report the whole frame of pixels at once in fixed intervals but have lower dynamic range and are prone to motion blur in case of rapid movements. We get the best from both worlds and use events and intensity images together in our complementary design and estimate dense disparity from this combination. The proposed end-to-end design combines events and images in a sequential manner and correlates them to esti-mate dense depth values. Our various experimental settings in real-world and simulated scenarios exploit the superiority of our method in predicting accurate depth values with fine details. We further extend our method to extreme cases of missing the left or right event or stereo pair and also investigate stereo depth estimation with inconsistent dynamic ranges or event thresholds on the left and right pairs
Code (0)
등록된 구현이 없습니다.
Tasks
Depth EstimationStereo Depth EstimationSimilar Papers 제목 키워드 기반
Deep Event Stereo Leveraged by Event-to-Image Translation
Depth estimation in real-world applications requires precise responses to fast motion and challenging lighting conditions. Event cameras use bio-inspired event-driven sensors that provide instantaneous and asynchronous i…
3D ReconstructionDepth EstimationDisparity EstimationEvent-based vision+2Video Frame Interpolation with Stereo Event and Intensity Camera
The stereo event-intensity camera setup is widely applied to leverage the advantages of both event cameras with low latency and intensity cameras that capture accurate brightness and texture information. However, such a …
Disparity EstimationOptical Flow EstimationVideo Frame InterpolationLearning Parallax for Stereo Event-based Motion Deblurring
Due to the extremely low latency, events have been recently exploited to supplement lost information for motion deblurring. Existing approaches largely rely on the perfect pixel-wise alignment between intensity images an…
DeblurringStereo MatchingGated Stereo: Joint Depth Estimation from Gated and Wide-Baseline Active Stereo Cues
We propose Gated Stereo, a high-resolution and long-range depth estimation technique that operates on active gated stereo images. Using active and high dynamic range passive captures, Gated Stereo exploits multi-view cue…
Depth EstimationDepth PredictionStereo Depth From Events Cameras: Concentrate and Focus on the Future
Neuromorphic cameras or event cameras mimic human vision by reporting changes in the intensity in a scene, instead of reporting the whole scene at once in a form of an image frame as performed by conventional cameras…
Depth Estimation