paper-with-me

Papers

Graph-based Spatial Transformer with Memory Replay for Multi-future Pedestrian Trajectory Prediction

2022-06-12 · CVPR 2022 1 · Lihuan Li, Maurice Pagnucco, Yang song

Pedestrian trajectory prediction is an essential and challenging task for a variety of real-life applications such as autonomous driving and robotic motion planning. Besides generating a single future path, predicting multiple plausible future paths is becoming popular in some recent work on trajectory prediction. However, existing methods typically emphasize spatial interactions between pedestrians and surrounding areas but ignore the smoothness and temporal consistency of predictions. Our model aims to forecast multiple paths based on a historical trajectory by modeling multi-scale graph-based spatial transformers combined with a trajectory smoothing algorithm named `Memory Replay'' utilizing a memory graph. Our method can comprehensively exploit the spatial information as well as correct the temporally inconsistent trajectories (e.g., sharp turns). We also propose a new evaluation metric named `Percentage of Trajectory Usage'' to evaluate the comprehensiveness of diverse multi-future predictions. Our extensive experiments show that the proposed model achieves state-of-the-art performance on multi-future prediction and competitive results for single-future prediction. Code released at https://github.com/Jacobieee/ST-MR.

📄 PDF Abstract BibTeX arXiv:2206.05712

Code (1)

jacobieee/st-mr 공식 구현 pytorch

Tasks

Autonomous DrivingFuture predictionMotion PlanningPedestrian Trajectory PredictionPredictionTrajectory Prediction

Similar Papers 제목 키워드 기반

Transformer with Memory Replay

2022-05-19 · Rui Liu, Barzan Mozafari

Transformers achieve state-of-the-art performance for natural language processing tasks by pre-training on large-scale text corpora. They are extremely compute-intensive and have very high sample complexity. Memory repla…

Graph Continual Learning with Debiased Lossless Memory Replay

2024-04-17 · Chaoxi Niu, Guansong Pang, Ling Chen

Real-life graph data often expands continually, rendering the learning of graph neural networks (GNNs) on static graph data impractical. Graph continual learning (GCL) tackles this problem by continually adapting GNNs to…

Continual LearningIncremental Learning

CaT: Balanced Continual Graph Learning with Graph Condensation

2023-09-18 · Yilun Liu, Ruihong Qiu, Zi Huang

Continual graph learning (CGL) is purposed to continuously update a graph model with graph data being fed in a streaming manner. Since the model easily forgets previously learned knowledge when training with new-coming d…

Continual LearningGraph Learning

Echo-Memory: A Controlled Study of Memory in Action World Models

2026-06-08 · Wayne King, Zeyue Xue, Yuxuan Bian, Jie Huang 외 arxiv

We present \textbf{Echo-Memory}, a controlled study of memory mechanisms in action-conditioned world models. These models generate multi-segment videos from a first frame, text prompt, and camera-action sequence, but the…

Qgraph-bounded Q-learning: Stabilizing Model-Free Off-Policy Deep Reinforcement Learning

2020-07-15 · Sabrina Hoppe, Marc Toussaint

In state of the art model-free off-policy deep reinforcement learning, a replay memory is used to store past experience and derive all network updates. Even if both state and action spaces are continuous, the replay memo…

Deep Reinforcement LearningQ-Learningreinforcement-learningReinforcement Learning (RL)