paper-with-me

홈 › Papers

Trajectory Mamba: Efficient Attention-Mamba Forecasting Model Based on Selective SSM

2025-03-13 · CVPR 2025 1 · Yizhou Huang, Yihua Cheng, Kezhi Wang

Motion prediction is crucial for autonomous driving, as it enables accurate forecasting of future vehicle trajectories based on historical inputs. This paper introduces Trajectory Mamba, a novel efficient trajectory prediction framework based on the selective state-space model (SSM). Conventional attention-based models face the challenge of computational costs that grow quadratically with the number of targets, hindering their application in highly dynamic environments. In response, we leverage the SSM to redesign the self-attention mechanism in the encoder-decoder architecture, thereby achieving linear time complexity. To address the potential reduction in prediction accuracy resulting from modifications to the attention mechanism, we propose a joint polyline encoding strategy to better capture the associations between static and dynamic contexts, ultimately enhancing prediction accuracy. Additionally, to balance prediction accuracy and inference speed, we adopted the decoder that differs entirely from the encoder. Through cross-state space attention, all target agents share the scene context, allowing the SSM to interact with the shared scene representation during decoding, thus inferring different trajectories over the next prediction steps. Our model achieves state-of-the-art results in terms of inference speed and parameter efficiency on both the Argoverse 1 and Argoverse 2 datasets. It demonstrates a four-fold reduction in FLOPs compared to existing methods and reduces parameter count by over 40% while surpassing the performance of the vast majority of previous methods. These findings validate the effectiveness of Trajectory Mamba in trajectory prediction tasks.

📄 PDF Abstract BibTeX arXiv:2503.10898

Code (1)

YiZhou-H/Trajectory-Mamba-CVPR pytorch

Tasks

Autonomous DrivingDecoderMambamotion predictionPredictionTrajectory Prediction

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Mamba Foundation models, now powering most of the exciting applications in deep learning, are almost universally based on the Transformer architecture and its core attention module.…
SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

Social-Mamba: Socially-Aware Trajectory Forecasting with State-Space Models

2026-05-14 · Po-Chien Luan, Wuyang Li, Yang Gao, Alexandre Alahi arxiv

Human trajectory forecasting is crucial for safe navigation in crowded environments, requiring models that balance accuracy with computational efficiency. Efficiently modeling social interactions is key to performance in…

Computational EfficiencyTrajectory Forecasting

FMamba: Mamba based on Fast-attention for Multivariate Time-series Forecasting

2024-07-20 · Shusen Ma, Yu Kang, Peng Bai, Yun-Bo Zhao

In multivariate time-series forecasting (MTSF), extracting the temporal correlations of the input sequences is crucial. While popular Transformer-based predictive models can perform well, their quadratic computational co…

MambaMultivariate Time Series ForecastingTime SeriesTime Series Forecasting

MambaMixer: Efficient Selective State Space Models with Dual Token and Channel Selection

2024-03-29 · Ali Behrouz, Michele Santacatterina, Ramin Zabih

Recent advances in deep learning have mainly relied on Transformers due to their data dependency and ability to learn at scale. The attention module in these architectures, however, exhibits quadratic time and space in i…

channel selectionImage Classificationobject-detectionObject Detection+4

HiSTM: Hierarchical Spatiotemporal Mamba for Cellular Traffic Forecasting

2025-08-07 · Zineddine Bettouche, Khalid Ali, Andreas Fischer, Andreas Kassler arxiv

Cellular traffic forecasting is essential for network planning, resource allocation, or load-balancing traffic across cells. However, accurate forecasting is difficult due to intricate spatial and temporal patterns that …

Computational Efficiency

MambaTS: Improved Selective State Space Models for Long-term Time Series Forecasting

2024-05-26 · Xiuding Cai, Yaoyao Zhu, Xueyao Wang, Yu Yao

In recent years, Transformers have become the de-facto architecture for long-term sequence forecasting (LTSF), but faces challenges such as quadratic complexity and permutation invariant bias. A recent model, Mamba, base…

MambaState Space ModelsTime SeriesTime Series Forecasting