paper-with-me

Papers

Event-Intensity Stereo: Estimating Depth by the Best of Both Worlds

2021-01-01 · ICCV 2021 10 · Mohammad Mostafavi, Kuk-Jin Yoon, Jonghyun Choi

Event cameras can report scene movements as an asynchronous stream of data called the events. Unlike traditional cameras, event cameras have very low latency (microseconds vs milliseconds) very high dynamic range (140dB vs 60 dB), and low power consumption, as they report changes of a scene and not a complete frame. As they re-port per pixel feature-like events and not the whole intensity frame they are immune to motion blur. However, event cameras require movement between the scene and camera to fire events ,i.e., they have no output when the scene is relatively static. Traditional cameras, however, report the whole frame of pixels at once in fixed intervals but have lower dynamic range and are prone to motion blur in case of rapid movements. We get the best from both worlds and use events and intensity images together in our complementary design and estimate dense disparity from this combination. The proposed end-to-end design combines events and images in a sequential manner and correlates them to esti-mate dense depth values. Our various experimental settings in real-world and simulated scenarios exploit the superiority of our method in predicting accurate depth values with fine details. We further extend our method to extreme cases of missing the left or right event or stereo pair and also investigate stereo depth estimation with inconsistent dynamic ranges or event thresholds on the left and right pairs

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Depth EstimationStereo Depth Estimation

Similar Papers 제목 키워드 기반

Deep Event Stereo Leveraged by Event-to-Image Translation

2021-02-02 · Soikat Hasan Ahmed, Hae Woong Jang, S. M. Nadim Uddin, Yong Ju Jung

Depth estimation in real-world applications requires precise responses to fast motion and challenging lighting conditions. Event cameras use bio-inspired event-driven sensors that provide instantaneous and asynchronous i…

3D ReconstructionDepth EstimationDisparity EstimationEvent-based vision+2

Video Frame Interpolation with Stereo Event and Intensity Camera

2023-07-17 · Chao Ding, Mingyuan Lin, Haijian Zhang, Jianzhuang Liu 외

The stereo event-intensity camera setup is widely applied to leverage the advantages of both event cameras with low latency and intensity cameras that capture accurate brightness and texture information. However, such a …

Disparity EstimationOptical Flow EstimationVideo Frame Interpolation

Learning Parallax for Stereo Event-based Motion Deblurring

2023-09-18 · Mingyuan Lin, Chi Zhang, Chu He, Lei Yu

Due to the extremely low latency, events have been recently exploited to supplement lost information for motion deblurring. Existing approaches largely rely on the perfect pixel-wise alignment between intensity images an…

DeblurringStereo Matching

Gated Stereo: Joint Depth Estimation from Gated and Wide-Baseline Active Stereo Cues

2023-05-22 · CVPR 2023 1 · Stefanie Walz, Mario Bijelic, Andrea Ramazzina, Amanpreet Walia 외

We propose Gated Stereo, a high-resolution and long-range depth estimation technique that operates on active gated stereo images. Using active and high dynamic range passive captures, Gated Stereo exploits multi-view cue…

Depth EstimationDepth Prediction

Stereo Depth From Events Cameras: Concentrate and Focus on the Future

2022-01-01 · CVPR 2022 1 · Yeongwoo Nam, Mohammad Mostafavi, Kuk-Jin Yoon, Jonghyun Choi

Neuromorphic cameras or event cameras mimic human vision by reporting changes in the intensity in a scene, instead of reporting the whole scene at once in a form of an image frame as performed by conventional cameras…

Depth Estimation