Future Semantic Segmentation with Convolutional LSTM
We consider the problem of predicting semantic segmentation of future frames in a video. Given several observed frames in a video, our goal is to predict the semantic segmentation map of future frames that are not yet observed. A reliable solution to this problem is useful in many applications that require real-time decision making, such as autonomous driving. We propose a novel model that uses convolutional LSTM (ConvLSTM) to encode the spatiotemporal information of observed frames for future prediction. We also extend our model to use bidirectional ConvLSTM to capture temporal information in both directions. Our proposed approach outperforms other state-of-the-art methods on the benchmark dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingDecision MakingFuture predictionSegmentationSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Seg-LSTM: Performance of xLSTM for Semantic Segmentation of Remotely Sensed Images
Recent advancements in autoregressive networks with linear complexity have driven significant research progress, demonstrating exceptional performance in large language models. A representative model is the Extended Long…
Decoderimage-classificationImage ClassificationMamba+2Separable Convolutional LSTMs for Faster Video Segmentation
Semantic Segmentation is an important module for autonomous robots such as self-driving cars. The advantage of video segmentation approaches compared to single image segmentation is that temporal image information is con…
GPUImage SegmentationSegmentationSelf-Driving Cars+3Semantic Segmentation of Video Sequences with Convolutional LSTMs
Most of the semantic segmentation approaches have been developed for single image segmentation, and hence, video sequences are currently segmented by processing each frame of the video sequence separately. The disadvanta…
DecoderImage SegmentationPositionSegmentation+3STFCN: Spatio-Temporal FCN for Semantic Video Segmentation
This paper presents a novel method to involve both spatial and temporal features for semantic video segmentation. Current work on convolutional neural networks(CNNs) has shown that CNNs provide advanced spatial features …
SegmentationSemantic SegmentationVideo SegmentationVideo Semantic SegmentationNoisy-LSTM: Improving Temporal Awareness for Video Semantic Segmentation
Semantic video segmentation is a key challenge for various applications. This paper presents a new model named Noisy-LSTM, which is trainable in an end-to-end manner, with convolutional LSTMs (ConvLSTMs) to leverage the …
Semantic SegmentationVideo SegmentationVideo Semantic Segmentation