paper-with-me

홈 › Papers

Future Semantic Segmentation with Convolutional LSTM

2018-07-20 · Seyed shahabeddin Nabavi, Mrigank Rochan, Yang, Wang

We consider the problem of predicting semantic segmentation of future frames in a video. Given several observed frames in a video, our goal is to predict the semantic segmentation map of future frames that are not yet observed. A reliable solution to this problem is useful in many applications that require real-time decision making, such as autonomous driving. We propose a novel model that uses convolutional LSTM (ConvLSTM) to encode the spatiotemporal information of observed frames for future prediction. We also extend our model to use bidirectional ConvLSTM to capture temporal information in both directions. Our proposed approach outperforms other state-of-the-art methods on the benchmark dataset.

📄 PDF Abstract BibTeX arXiv:1807.07946

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous DrivingDecision MakingFuture predictionSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
ConvLSTM ConvLSTM is a type of recurrent neural network for spatio-temporal prediction that has convolutional structures in both the input-to-state and state-to-state transitions. The…
Sigmoid Activation 설명 없음
Tanh Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…

Similar Papers 제목 키워드 기반

Seg-LSTM: Performance of xLSTM for Semantic Segmentation of Remotely Sensed Images

2024-06-20 · Qinfeng Zhu, Yuanzhi Cai, Lei Fan

Recent advancements in autoregressive networks with linear complexity have driven significant research progress, demonstrating exceptional performance in large language models. A representative model is the Extended Long…

Decoderimage-classificationImage ClassificationMamba+2

Separable Convolutional LSTMs for Faster Video Segmentation

2019-07-16 · Andreas Pfeuffer, Klaus Dietmayer

Semantic Segmentation is an important module for autonomous robots such as self-driving cars. The advantage of video segmentation approaches compared to single image segmentation is that temporal image information is con…

GPUImage SegmentationSegmentationSelf-Driving Cars+3

Semantic Segmentation of Video Sequences with Convolutional LSTMs

2019-05-03 · Andreas Pfeuffer, Karina Schulz, Klaus Dietmayer

Most of the semantic segmentation approaches have been developed for single image segmentation, and hence, video sequences are currently segmented by processing each frame of the video sequence separately. The disadvanta…

DecoderImage SegmentationPositionSegmentation+3

STFCN: Spatio-Temporal FCN for Semantic Video Segmentation

2016-08-21 · Mohsen Fayyaz, Mohammad Hajizadeh Saffar, Mohammad Sabokrou, Mahmood Fathy 외

This paper presents a novel method to involve both spatial and temporal features for semantic video segmentation. Current work on convolutional neural networks(CNNs) has shown that CNNs provide advanced spatial features …

SegmentationSemantic SegmentationVideo SegmentationVideo Semantic Segmentation

Noisy-LSTM: Improving Temporal Awareness for Video Semantic Segmentation

2020-10-19 · Bowen Wang, Liangzhi Li, Yuta Nakashima, Ryo Kawasaki 외

Semantic video segmentation is a key challenge for various applications. This paper presents a new model named Noisy-LSTM, which is trainable in an end-to-end manner, with convolutional LSTMs (ConvLSTMs) to leverage the …

Semantic SegmentationVideo SegmentationVideo Semantic Segmentation