Scalable Event-Based Video Streaming for Machines with MoQ
Lossy compression and rate-adaptive streaming are a mainstay in traditional video steams. However, a new class of neuromorphic ``event'' sensors records video with asynchronous pixel samples rather than image frames. These sensors are designed for computer vision applications, rather than human video consumption. Until now, researchers have focused their efforts primarily on application development, ignoring the crucial problem of data transmission. We survey the landscape of event-based video systems, discuss the technical issues with our recent scalable event streaming work, and propose a new low-latency event streaming format based on the latest additions to the Media Over QUIC protocol draft.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Low-Latency Scalable Streaming for Event-Based Vision
Recently, we have witnessed the rise of novel ``event-based'' camera sensors for high-speed, low-power video capture. Rather than recording discrete image frames, these sensors output asynchronous ``event'' tuples with m…
Event-based visionGPUobject-detectionObject DetectionLearned Scalable Video Coding For Humans and Machines
Video coding has traditionally been developed to support services such as video streaming, videoconferencing, digital TV, and so on. The main intent was to enable human viewing of the encoded content. However, with the a…
Object Detectionvehicle detectionVideo CompressionDon't Pause! Every prediction matters in a streaming video
Streaming video models should respond the moment an event unfolds, not after the moment has passed. Yet existing online VideoQA benchmarks remain largely retrospective. They pause the video at fixed timestamps, pose ques…
Generalized Event Partonomy Inference with Structured Hierarchical Predictive Learning
Humans naturally perceive continuous experience as a hierarchy of temporally nested events, fine-grained actions embedded within coarser routines. Replicating this structure in computer vision requires models that can se…
Streaming Detection of Queried Event Start
Robotics, autonomous driving, augmented reality, and many embodied computer vision applications must quickly react to user-defined events unfolding in real time. We address this setting by proposing a novel task for mult…
Autonomous Drivingparameter-efficient fine-tuningTransfer LearningVideo Understanding