Learning to Super Resolve Intensity Images from Events
An event camera detects per-pixel intensity difference and produces asynchronous event stream with low latency, high dynamic range, and low power consumption. As a trade-off, the event camera has low spatial resolution. We propose an end-to-end network to reconstruct high resolution, high dynamic range (HDR) images directly from the event stream. We evaluate our algorithm on both simulated and real-world sequences and verify that it captures fine details of a scene and outperforms the combination of the state-of-the-art event to image algorithms with the state-of-the-art super resolution schemes in many quantitative measures by large margins. We further extend our method by using the active sensor pixel (APS) frames or reconstructing images iteratively.
Code (1)
Tasks
Image ReconstructionSuper-ResolutionSimilar Papers 제목 키워드 기반
EvIntSR-Net: Event Guided Multiple Latent Frames Reconstruction and Super-Resolution
An event camera detects the scene radiance changes and sends a sequence of asynchronous event streams with high dynamic range, high temporal resolution, and low latency. However, the spatial resolution of event camer…
Super-ResolutionEventZoom: Learning To Denoise and Super Resolve Neuromorphic Events
We address the problem of jointly denoising and super resolving neuromorphic events, a novel visual signal that represents thresholded temporal gradients in a space-time window. The challenge for event signal process…
DenoisingImage ReconstructionObject TrackingVisual Object TrackingLearning to Super-Resolve Blurry Images with Events
Super-Resolution from a single motion Blurred image (SRB) is a severely ill-posed problem due to the joint degradation of motion blurs and low spatial resolution. In this paper, we employ events to alleviate the burden o…
Sparse LearningSuper-ResolutionEventSR: From Asynchronous Events to Image Reconstruction, Restoration, and Super-Resolution via End-to-End Adversarial Learning
Event cameras sense intensity changes and have many advantages over conventional cameras. To take advantage of event cameras, some methods have been proposed to reconstruct intensity images from event streams. However, t…
Image ReconstructionSuper-ResolutionLearning Parallax for Stereo Event-based Motion Deblurring
Due to the extremely low latency, events have been recently exploited to supplement lost information for motion deblurring. Existing approaches largely rely on the perfect pixel-wise alignment between intensity images an…
DeblurringStereo Matching