paper-with-me

홈 › Papers

Attention Augmented ConvLSTM for Environment Prediction

2020-10-19 · Bernard Lange, Masha Itkina, Mykel J. Kochenderfer

Safe and proactive planning in robotic systems generally requires accurate predictions of the environment. Prior work on environment prediction applied video frame prediction techniques to bird's-eye view environment representations, such as occupancy grids. ConvLSTM-based frameworks used previously often result in significant blurring and vanishing of moving objects, thus hindering their applicability for use in safety-critical applications. In this work, we propose two extensions to the ConvLSTM to address these issues. We present the Temporal Attention Augmented ConvLSTM (TAAConvLSTM) and Self-Attention Augmented ConvLSTM (SAAConvLSTM) frameworks for spatiotemporal occupancy prediction, and demonstrate improved performance over baseline architectures on the real-world KITTI and Waymo datasets.

📄 PDF Abstract BibTeX arXiv:2010.09662

Code (1)

sisl/AttentionAugmentedConvLSTM 공식 구현 pytorch

Tasks

Prediction

Methods 이 논문이 사용한 방법론

Sigmoid Activation 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Tanh Activation 설명 없음
ConvLSTM ConvLSTM is a type of recurrent neural network for spatio-temporal prediction that has convolutional structures in both the input-to-state and state-to-state transitions. The…

Similar Papers 제목 키워드 기반

Self-Attention ConvLSTM for Spatiotemporal Prediction

2020-04-03 · AAAI 2020 4 · Zhihui Lin, Maomao Li, Zhuobin Zheng, Yangyang Cheng 외

Spatiotemporal prediction is challenging due to the complex dynamic motion and appearance changes. Existing work concentrates on embedding additional cells into the standard ConvLSTM to memorize spatial appearances durin…

PredictionVideo Prediction

Field Validation of a Multi-Resolution ConvLSTM Framework for Retaining Wall Deformation Prediction

2026-06-04 · Jihoon Kim, Saeyon Kim, Heejung Youn arxiv

This study presents a comprehensive field validation of a multi-resolution Convolutional Long Short-Term Memory (ConvLSTM) framework for predicting retaining wall deformation during staged excavation. The framework is tr…

FACLSTM: ConvLSTM with Focused Attention for Scene Text Recognition

2019-04-20 · Qingqing Wang, Wenjing Jia, Xiangjian He, Yue Lu 외

Scene text recognition has recently been widely treated as a sequence-to-sequence prediction problem, where traditional fully-connected-LSTM (FC-LSTM) has played a critical role. Due to the limitation of FC-LSTM, existin…

PredictionScene Text Recognition

Going From Image to Video Saliency: Augmenting Image Salience With Dynamic Attentional Push

2018-06-01 · CVPR 2018 6 · Siavash Gorji, James J. Clark

We present a novel method to incorporate the recent advent in static saliency models to predict the saliency in videos. Our model augments the static saliency models with the Attentional Push effect of the photographer …

TopoFormer: Integrating Transformers and ConvLSTMs for Coastal Topography Prediction

2025-01-11 · Santosh Munian, Oktay Karakuş, William Russell, Gwyn Nelson

This paper presents \textit{TopoFormer}, a novel hybrid deep learning architecture that integrates transformer-based encoders with convolutional long short-term memory (ConvLSTM) layers for the precise prediction of topo…

Survey