paper-with-me

홈 › Papers

How Asynchronous Events Encode Video

2022-06-09 · Karen Adam, Adam Scholefield, Martin Vetterli

As event-based sensing gains in popularity, theoretical understanding is needed to harness this technology's potential. Instead of recording video by capturing frames, event-based cameras have sensors that emit events when their inputs change, thus encoding information in the timing of events. This creates new challenges in establishing reconstruction guarantees and algorithms, but also provides advantages over frame-based video. We use time encoding machines to model event-based sensors: TEMs also encode their inputs by emitting events characterized by their timing and reconstruction from time encodings is well understood. We consider the case of time encoding bandlimited video and demonstrate a dependence between spatial sensor density and overall spatial and temporal resolution. Such a dependence does not occur in frame-based video, where temporal resolution depends solely on the frame rate of the video and spatial resolution depends solely on the pixel grid. However, this dependence arises naturally in event-based video and allows oversampling in space to provide better time resolution. As such, event-based vision encourages using more sensors that emit fewer events over time.

📄 PDF Abstract BibTeX arXiv:2206.04341

Code (0)

등록된 구현이 없습니다.

Tasks

Event-based vision

Similar Papers 제목 키워드 기반

Combining Events and Frames using Recurrent Asynchronous Multimodal Networks for Monocular Depth Prediction

2021-02-18 · Daniel Gehrig, Michelle Rüegg, Mathias Gehrig, Javier Hidalgo Carrio 외

Event cameras are novel vision sensors that report per-pixel brightness changes as a stream of asynchronous "events". They offer significant advantages compared to standard cameras due to their high temporal resolution, …

Depth EstimationDepth PredictionMonocular Depth EstimationObject Detection

Graph-based Asynchronous Event Processing for Rapid Object Recognition

2023-08-28 · ICCV 2021 10 · Yijin Li, Han Zhou, Bangbang Yang, Ye Zhang 외

Different from traditional video cameras, event cameras capture asynchronous events stream in which each event encodes pixel location, trigger time, and the polarity of the brightness changes. In this paper, we introduce…

graph constructionObject Recognition

Turning Frequency to Resolution: Video Super-Resolution via Event Cameras

2021-06-19 · CVPR 2021 1 · Yongcheng Jing, Yiding Yang, Xinchao Wang, Mingli Song 외

State-of-the-art video super-resolution (VSR) methods focus on exploiting inter- and intra-frame correlations to estimate high-resolution (HR) video frames from low-resolution (LR) ones. In this paper, we study VSR f…

Super-ResolutionVideo Super-Resolution

"Seeing'' Electric Network Frequency from Events

2023-05-04 · Lexuan Xu, Guang Hua, Haijian Zhang, Lei Yu 외

Most of the artificial lights fluctuate in response to the grid's alternating current and exhibit subtle variations in terms of both intensity and spectrum, providing the potential to estimate the Electric Network Freque…

ENF (Electric Network Frequency) Extraction

"Seeing" Electric Network Frequency From Events

2023-01-01 · CVPR 2023 1 · Lexuan Xu, Guang Hua, Haijian Zhang, Lei Yu 외

Most of the artificial lights fluctuate in response to the grid's alternating current and exhibit subtle variations in terms of both intensity and spectrum, providing the potential to estimate the Electric Network Fr…

ENF (Electric Network Frequency) Extraction