paper-with-me

Papers

Autoregressive Denoising Diffusion Models for Multivariate Probabilistic Time Series Forecasting

2021-01-28 · Kashif Rasul, Calvin Seward, Ingmar Schuster, Roland Vollgraf

In this work, we propose \texttt{TimeGrad}, an autoregressive model for multivariate probabilistic time series forecasting which samples from the data distribution at each time step by estimating its gradient. To this end, we use diffusion probabilistic models, a class of latent variable models closely connected to score matching and energy-based methods. Our model learns gradients by optimizing a variational bound on the data likelihood and at inference time converts white noise into a sample of the distribution of interest through a Markov chain using Langevin sampling. We demonstrate experimentally that the proposed autoregressive denoising diffusion model is the new state-of-the-art multivariate probabilistic forecasting method on real-world data sets with thousands of correlated dimensions. We hope that this method is a useful tool for practitioners and lays the foundation for future research in this area.

📄 PDF Abstract BibTeX arXiv:2101.12072

Code (1)

zalandoresearch/pytorch-ts 공식 구현 pytorch

Tasks

Multivariate Time Series ForecastingProbabilistic Time Series ForecastingTime SeriesTime Series AnalysisTime Series Forecasting

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

TIMED: Adversarial and Autoregressive Refinement of Diffusion-Based Time Series Generation

2025-09-23 · MohammadReza EskandariNasab, Shah Muhammad Hamdi, Soukaina Filali Boubrahimi arxiv

Generating high-quality synthetic time series is a fundamental yet challenging task across domains such as forecasting and anomaly detection, where real data can be scarce, noisy, or costly to collect. Unlike static data…

Anomaly Detection

Channel-aware Contrastive Conditional Diffusion for Multivariate Probabilistic Time Series Forecasting

2024-10-03 · Siyang Li, Yize Chen, Hui Xiong

Forecasting faithful trajectories of multivariate time series from practical scopes is essential for reasonable decision-making. Recent methods majorly tailor generative conditional diffusion models to estimate the targe…

Contrastive LearningDenoisingProbabilistic Time Series ForecastingTime Series+1

Non-Autoregressive Diffusion-based Temporal Point Processes for Continuous-Time Long-Term Event Prediction

2023-11-02 · Wang-Tao Zhou, Zhao Kang, Ling Tian

Continuous-time long-term event prediction plays an important role in many application scenarios. Most existing works rely on autoregressive frameworks to predict event sequences, which suffer from error accumulation, th…

DenoisingPoint ProcessesPrediction

CLIP-Diffusion-LM: Apply Diffusion Model on Image Captioning

2022-10-10 · Shitong Xu

Image captioning task has been extensively researched by previous work. However, limited experiments focus on generating captions based on non-autoregressive text decoder. Inspired by the recent success of the denoising …

DecoderDenoisingImage CaptioningImage Generation+1

Denoising Diffusion Probabilistic Models

2020-06-19 · NeurIPS 2020 12 · Jonathan Ho, Ajay Jain, Pieter Abbeel

We present high quality image synthesis results using diffusion probabilistic models, a class of latent variable models inspired by considerations from nonequilibrium thermodynamics. Our best results are obtained by trai…

DenoisingDensity EstimationImage Generation