paper-with-me

Papers

Asynchrony Increases Efficiency: Time Encoding of Videos and Low-Rank Signals

2021-04-29 · Karen Adam, Adam Scholefield, Martin Vetterli

In event-based sensing, many sensors independently and asynchronously emit events when there is a change in their input. Event-based sensing can present significant improvements in power efficiency when compared to traditional sampling, because (1) the output is a stream of events where the important information lies in the timing of the events, and (2) the sensor can easily be controlled to output information only when interesting activity occurs at the input. Moreover, event-based sampling can often provide better resolution than standard uniform sampling. Not only does this occur because individual event-based sensors have higher temporal resolution, it also occurs because the asynchrony of events allows for less redundant and more informative encoding. We would like to explain how such curious results come about. To do so, we use ideal time encoding machines as a proxy for event-based sensors. We explore time encoding of signals with low rank structure, and apply the resulting theory to video. We then see how the asynchronous firing times of the time encoding machines allow for better reconstruction than in the standard sampling case, if we have a high spatial density of time encoding machines that fire less frequently.

📄 PDF Abstract BibTeX arXiv:2104.14511

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Asynchrony begets Momentum, with an Application to Deep Learning

2016-05-31 · Ioannis Mitliagkas, Ce Zhang, Stefan Hadjis, Christopher Ré

Asynchronous methods are widely used in deep learning, but have limited theoretical justification when applied to non-convex problems. We show that running stochastic gradient descent (SGD) in an asynchronous manner can …

Deep Learning

4DSloMo: 4D Reconstruction for High Speed Scene with Asynchronous Capture

2025-07-07 · Yutian Chen, Shi Guo, Tianshuo Yang, Lihe Ding 외

Reconstructing fast-dynamic scenes from multi-view videos is crucial for high-speed motion analysis and realistic 4D reconstruction. However, the majority of 4D capture systems are limited to frame rates below 30 FPS (fr…

4D reconstruction

On the Audio-visual Synchronization for Lip-to-Speech Synthesis

2023-03-01 · ICCV 2023 1 · Zhe Niu, Brian Mak

Most lip-to-speech (LTS) synthesis models are trained and evaluated under the assumption that the audio-video pairs in the dataset are perfectly synchronized. In this work, we show that the commonly used audio-visual dat…

Audio-Visual SynchronizationLip to Speech SynthesisSpeech Synthesis

Overreliance on AI in Information-seeking from Video Content

2026-03-20 · Anders Giovanni Møller, Elisa Bassignana, Francesco Pierri, Luca Maria Aiello arxiv

The ubiquity of multimedia content is reshaping online information spaces, particularly in social media environments. At the same time, search is being rapidly transformed by generative AI, with large language models (LL…

Information Retrieval

Trajectory Balance with Asynchrony: Decoupling Exploration and Learning for Fast, Scalable LLM Post-Training

2025-03-24 · Brian R. Bartoldson, Siddarth Venkatraman, James Diffenderfer, Moksh Jain 외

Reinforcement learning (RL) is a critical component of large language model (LLM) post-training. However, existing on-policy algorithms used for post-training are inherently incompatible with the use of experience replay…

DiversityLarge Language ModelMathematical ReasoningRed Teaming+1