Real-Time Intensity-Image Reconstruction for Event Cameras Using Manifold Regularisation
Event cameras or neuromorphic cameras mimic the human perception system as they measure the per-pixel intensity change rather than the actual intensity level. In contrast to traditional cameras, such cameras capture new information about the scene at MHz frequency in the form of sparse events. The high temporal resolution comes at the cost of losing the familiar per-pixel intensity information. In this work we propose a variational model that accurately models the behaviour of event cameras, enabling reconstruction of intensity images with arbitrary frame rate in real-time. Our method is formulated on a per-event-basis, where we explicitly incorporate information about the asynchronous nature of events via an event manifold induced by the relative timestamps of events. In our experiments we verify that solving the variational model on the manifold produces high-quality images without explicitly estimating optical flow.
Code (1)
Tasks
Image ReconstructionOptical Flow EstimationSimilar Papers 제목 키워드 기반
An Event-based Fast Intensity Reconstruction Scheme for UAV Real-time Perception
Event cameras offer significant advantages, including a wide dynamic range, high temporal resolution, and immunity to motion blur, making them highly promising for addressing challenging visual conditions. Extracting and…
Visual TrackingHigh Speed and High Dynamic Range Video with an Event Camera
Event cameras are novel sensors that report brightness changes in the form of a stream of asynchronous "events" instead of intensity frames. They offer significant advantages with respect to conventional cameras: high te…
Event-based Object SegmentationVideo ReconstructionVocal Bursts Intensity PredictionPhotorealistic Image Reconstruction from Hybrid Intensity and Event based Sensor
Event sensors output a stream of asynchronous brightness changes (called ``events'') at a very high temporal rate. Previous works on recovering the lost intensity information from the event sensor data have heavily relie…
Image ReconstructionEBAD-Gaussian: Event-driven Bundle Adjusted Deblur Gaussian Splatting
While 3D Gaussian Splatting (3D-GS) achieves photorealistic novel view synthesis, its performance degrades with motion blur. In scenarios with rapid motion or low-light conditions, existing RGB-based deblurring methods s…
3D Scene ReconstructionDeblurringNovel View SynthesisEvIntSR-Net: Event Guided Multiple Latent Frames Reconstruction and Super-Resolution
An event camera detects the scene radiance changes and sends a sequence of asynchronous event streams with high dynamic range, high temporal resolution, and low latency. However, the spatial resolution of event camer…
Super-Resolution