paper-with-me

Papers

Progressive Spatio-Temporal Alignment for Efficient Event-Based Motion Estimation

2023-01-01 · CVPR 2023 1 · Xueyan Huang, Yueyi Zhang, Zhiwei Xiong

In this paper, we propose an efficient event-based motion estimation framework for various motion models. Different from previous works, we design a progressive event-to-map alignment scheme and utilize the spatio-temporal correlations to align events. In detail, we progressively align sampled events in an event batch to the time-surface map and obtain the updated motion model by minimizing a novel time-surface loss. In addition, a dynamic batch size strategy is applied to adaptively adjust the batch size so that all events in the batch are consistent with the current motion model. Our framework has three advantages: a) the progressive scheme refines motion parameters iteratively, achieving accurate motion estimation; b) within one iteration, only a small portion of events are involved in optimization, which greatly reduces the total runtime; c) the dynamic batch size strategy ensures that the constant velocity assumption always holds. We conduct comprehensive experiments to evaluate our framework on challenging high-speed scenes with three motion models: rotational, homography, and 6-DOF models. Experimental results demonstrate that our framework achieves state-of-the-art estimation accuracy and efficiency.

📄 PDF Abstract BibTeX

Code (1)

huangxueyan/peme 공식 구현

Tasks

Event-based Motion EstimationMotion Estimation

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

EvTexture++: Event-Driven Texture Enhancement for Video Super-Resolution

2026-06-11 · Dachun Kai, Jiayao Lu, Yueyi Zhang, Xiaoyan Sun arxiv

Event-based vision has drawn increasing attention owing to its distinctive properties, including ultra-high temporal resolution and extreme dynamic range. Recent works have introduced it to video super-resolution (VSR) t…

Video Super-ResolutionEvent-based vision

PSTTS: A Plug-and-Play Token Selector for Efficient Event-based Spatio-temporal Representation Learning

2025-09-26 · Xiangmo Zhao, Nan Yang, Yang Wang, Zhanwen Liu arxiv

Mainstream event-based spatio-temporal representation learning methods typically process event streams by converting them into sequences of event frames, achieving remarkable performance. However, they neglect the high s…

Representation Learning

Progressive Spatio-Temporal Prototype Matching for Text-Video Retrieval

2023-01-01 · ICCV 2023 1 · Pandeng Li, Chen-Wei Xie, Liming Zhao, Hongtao Xie 외

The performance of text-video retrieval has been significantly improved by vision-language cross-modal learning schemes. The typical solution is to directly align the global video-level and sentence-level features d…

DiversityObjectRetrievalSentence+1

Rethinking RGB-Event Semantic Segmentation with a Novel Bidirectional Motion-enhanced Event Representation

2025-05-02 · Zhen Yao, Xiaowen Ying, Mooi Choo Chuah

Event cameras capture motion dynamics, offering a unique modality with great potential in various computer vision tasks. However, RGB-Event fusion faces three intrinsic misalignments: (i) temporal, (ii) spatial, and (iii…

Semantic Segmentation

Spatiotemporal Bundle Adjustment for Dynamic 3D Human Reconstruction in the Wild

2020-07-24 · Minh Vo, Yaser Sheikh, Srinivasa G. Narasimhan

Bundle adjustment jointly optimizes camera intrinsics and extrinsics and 3D point triangulation to reconstruct a static scene. The triangulation constraint, however, is invalid for moving points captured in multiple unsy…

3D Human Reconstruction