paper-with-me

홈 › Papers

Paths: Prompt-aware Spatio-temporal Transformer with Hierarchical Multi-modal Fusion for RGB-Event Video Person Re-Identification

2026-08-13 · Yakun Huo, Yingquan Wang, Yangyang Liu, Tianyu Yan, Yunzhi Zhuge, Pingping Zhang, Huchuan Lu arxiv

RGB-Event Video Person Re-Identification (RE-VReID) aims to retrieve specific person across non-overlapping cameras with complementary RGB videos and event streams. However, existing methods often decouple spatial and temporal modeling, which limits their interaction. In addition, global-level RGB-Event fusion fails to fully exploit fine-grained discriminative cues. To address these issues, we propose Paths, a unified framework with spatio-temporal modeling and hierarchical multi-modal fusion for RE-VReID. Specifically, we first design a Memory-Augmented Backbone (MAB) to maintain modality-specific identity prototypes for stable intra-modal representation learning. Then, we propose a Prompt-aware Spatio-temporal Transformer (PST) to jointly model spatial and temporal cues within a unified Transformer. Finally, we introduce a Hierarchical Multi-modal Fusion (HMF) to integrate RGB and event features at global and local levels. With these modules, our framework can learn robust and discriminative representations for RE-VReID. Extensive experiments on three public RE-VReID benchmarks including EvReID, MARS and iLIDS-VID, demonstrate the effectiveness of our proposed method. The code is available at https://github.com/Reflection0427/Paths.

📄 PDF Abstract BibTeX arXiv:2608.13092

Code (0)

등록된 구현이 없습니다.

Tasks

Person Re-IdentificationRepresentation Learning

Similar Papers 제목 키워드 기반

Causality-Aware Spatiotemporal Graph Neural Networks for Spatiotemporal Time Series Imputation

2024-03-18 · Baoyu Jing, Dawei Zhou, Kan Ren, Carl Yang

Spatiotemporal time series are usually collected via monitoring sensors placed at different locations, which usually contain missing values due to various failures, such as mechanical damages and Internet outages. Imputi…

Graph Neural NetworkImputationMissing ValuesTime Series

PromptST: Prompt-Enhanced Spatio-Temporal Multi-Attribute Prediction

2023-09-18 · Zijian Zhang, Xiangyu Zhao, Qidong Liu, Chunxu Zhang 외

In the era of information explosion, spatio-temporal data mining serves as a critical part of urban management. Considering the various fields demanding attention, e.g., traffic state, human activity, and social event, p…

AttributePrediction

Frequency-Aware Spatiotemporal Transformers for Video Inpainting Detection

2021-01-01 · ICCV 2021 10 · Bingyao Yu, Wanhua Li, Xiu Li, Jiwen Lu 외

In this paper, we propose a frequency-aware spatiotemporal transformers for deep In this paper, we propose a Frequency-Aware Spatiotemporal Transformer (FAST) for video inpainting detection, which aims to simultaneou…

DecoderVideo Inpainting

Spatio-Temporal Data Enhanced Vision-Language Model for Traffic Scene Understanding

2025-11-12 · Jingtian Ma, Jingyuan Wang, Wayne Xin Zhao, Guoping Liu 외 arxiv

Nowadays, navigation and ride-sharing apps have collected numerous images with spatio-temporal data. A core technology for analyzing such images, associated with spatiotemporal information, is Traffic Scene Understanding…

Scene UnderstandingFew-Shot Learning

STPFormer: A State-of-the-Art Pattern-Aware Spatio-Temporal Transformer for Traffic Forecasting

2025-08-19 · Jiayu Fang, Zhiqi Shao, S T Boris Choy, Junbin Gao arxiv

Spatio-temporal traffic forecasting is challenging due to complex temporal patterns, dynamic spatial structures, and diverse input formats. Although Transformer-based models offer strong global modeling, they often strug…

Representation LearningGraph Matching