paper-with-me

홈 › Papers

Implicit Stacked Autoregressive Model for Video Prediction

2023-03-14 · Minseok Seo, Hakjin Lee, Doyi Kim, Junghoon Seo

Future frame prediction has been approached through two primary methods: autoregressive and non-autoregressive. Autoregressive methods rely on the Markov assumption and can achieve high accuracy in the early stages of prediction when errors are not yet accumulated. However, their performance tends to decline as the number of time steps increases. In contrast, non-autoregressive methods can achieve relatively high performance but lack correlation between predictions for each time step. In this paper, we propose an Implicit Stacked Autoregressive Model for Video Prediction (IAM4VP), which is an implicit video prediction model that applies a stacked autoregressive method. Like non-autoregressive methods, stacked autoregressive methods use the same observed frame to estimate all future frames. However, they use their own predictions as input, similar to autoregressive methods. As the number of time steps increases, predictions are sequentially stacked in the queue. To evaluate the effectiveness of IAM4VP, we conducted experiments on three common future frame prediction benchmark datasets and weather\&climate prediction benchmark datasets. The results demonstrate that our proposed model achieves state-of-the-art performance.

📄 PDF Abstract BibTeX arXiv:2303.07849

Code (1)

seominseok0429/Implicit-Stacked-Autoregressive-Model-for-Video-Prediction 공식 구현 pytorch

Tasks

modelPredictionVideo PredictionWeather Forecasting

Similar Papers 제목 키워드 기반

HARP: Autoregressive Latent Video Prediction with High-Fidelity Image Generator

2022-09-15 · Younggyo Seo, Kimin Lee, Fangchen Liu, Stephen James 외

Video prediction is an important yet challenging problem; burdened with the tasks of generating future frames and learning environment dynamics. Recently, autoregressive latent video models have proved to be a powerful v…

Data AugmentationPredictionVideo PredictionVocal Bursts Intensity Prediction

Autoregressive Latent Video Prediction with High-Fidelity Image Generator

2021-09-29 · Younggyo Seo, Kimin Lee, Fangchen Liu, Stephen James 외

Video prediction is an important yet challenging problem; burdened with the tasks of generating future frames and learning environment dynamics. Recently, autoregressive latent video models have proved to be a powerful v…

Data AugmentationPredictionVideo PredictionVocal Bursts Intensity Prediction

STAR: STacked AutoRegressive Scheme for Unified Multimodal Learning

2025-12-15 · Jie Qin, Jiancheng Huang, Limeng Qiao, Lin Ma arxiv

Multimodal large language models (MLLMs) play a pivotal role in advancing the quest for general artificial intelligence. However, achieving unified target for multimodal understanding and generation remains challenging d…

Compositional Video Prediction

2019-08-22 · ICCV 2019 10 · Yufei Ye, Maneesh Singh, Abhinav Gupta, Shubham Tulsiani

We present an approach for pixel-level future prediction given an input image of a scene. We observe that a scene is comprised of distinct entities that undergo motion and present an approach that operationalizes this in…

Future predictionPredictionVideo Prediction

Video Diffusion Models with Local-Global Context Guidance

2023-06-05 · Siyuan Yang, Lu Zhang, Yu Liu, Zhizhuo Jiang 외

Diffusion models have emerged as a powerful paradigm in video synthesis tasks including prediction, generation, and interpolation. Due to the limitation of the computational budget, existing methods usually implement con…

Future predictionPredictionUnconditional Video GenerationVideo Generation+1