paper-with-me

Papers

Exploring Transformer-Augmented LSTM for Temporal and Spatial Feature Learning in Trajectory Prediction

2024-12-18 · Chandra Raskoti, Weizi Li

Accurate vehicle trajectory prediction is crucial for ensuring safe and efficient autonomous driving. This work explores the integration of Transformer based model with Long Short-Term Memory (LSTM) based technique to enhance spatial and temporal feature learning in vehicle trajectory prediction. Here, a hybrid model that combines LSTMs for temporal encoding with a Transformer encoder for capturing complex interactions between vehicles is proposed. Spatial trajectory features of the neighboring vehicles are processed and goes through a masked scatter mechanism in a grid based environment, which is then combined with temporal trajectory of the vehicles. This combined trajectory data are learned by sequential LSTM encoding and Transformer based attention layers. The proposed model is benchmarked against predecessor LSTM based methods, including STA-LSTM, SA-LSTM, CS-LSTM, and NaiveLSTM. Our results, while not outperforming it's predecessor, demonstrate the potential of integrating Transformers with LSTM based technique to build interpretable trajectory prediction model. Future work will explore alternative architectures using Transformer applications to further enhance performance. This study provides a promising direction for improving trajectory prediction models by leveraging transformer based architectures, paving the way for more robust and interpretable vehicle trajectory prediction system.

📄 PDF Abstract BibTeX arXiv:2412.13419

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous DrivingPredictionTrajectory Prediction

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Multi-Head Attention 설명 없음
Adam 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Sigmoid Activation 설명 없음
Position-Wise Feed-Forward Layer 설명 없음

Similar Papers 제목 키워드 기반

An Attention Enhanced Graph Convolutional LSTM Network for Skeleton-Based Action Recognition

2019-02-25 · CVPR 2019 6 · Chenyang Si, Wentao Chen, Wei Wang, Liang Wang 외

Skeleton-based action recognition is an important task that requires the adequate understanding of movement characteristics of a human action from the given skeleton sequence. Recent studies have shown that exploring spa…

Action RecognitionSkeleton Based Action RecognitionTemporal Action Localization

MS-LSTM: Exploring Spatiotemporal Multiscale Representations in Video Prediction Domain

2023-04-16 · Zhifeng Ma, Hao Zhang, Jie Liu

The drastic variation of motion in spatial and temporal dimensions makes the video prediction task extremely challenging. Existing RNN models obtain higher performance by deepening or widening the model. They obtain the …

Video Prediction

SwinLSTM:Improving Spatiotemporal Prediction Accuracy using Swin Transformer and LSTM

2023-08-19 · Song Tang, Chuang Li, Pu Zhang, RongNian Tang

Integrating CNNs and RNNs to capture spatiotemporal dependencies is a prevalent strategy for spatiotemporal prediction tasks. However, the property of CNNs to learn local spatial information decreases their efficiency in…

PredictionVideo Prediction

SwinLSTM: Improving Spatiotemporal Prediction Accuracy using Swin Transformer and LSTM

2023-01-01 · ICCV 2023 1 · Song Tang, Chuang Li, Pu Zhang, RongNian Tang

Integrating CNNs and RNNs to capture spatiotemporal dependencies is a prevalent strategy for spatiotemporal prediction tasks. However, the property of CNNs to learn local spatial information decreases their efficienc…

PredictionVideo Prediction

Exploiting temporal consistency for real-time video depth estimation

2019-08-10 · ICCV 2019 10 · Haokui Zhang, Chunhua Shen, Ying Li, Yuanzhouhan Cao 외

Accuracy of depth estimation from static images has been significantly improved recently, by exploiting hierarchical features from deep convolutional neural networks (CNNs). Compared with static images, vast information …

Depth EstimationMonocular Depth Estimation