paper-with-me

Papers

Auto-Regressive Moving Diffusion Models for Time Series Forecasting

2024-12-12 · Jiaxin Gao, Qinglong Cao, Yuntian Chen

Time series forecasting (TSF) is essential in various domains, and recent advancements in diffusion-based TSF models have shown considerable promise. However, these models typically adopt traditional diffusion patterns, treating TSF as a noise-based conditional generation task. This approach neglects the inherent continuous sequential nature of time series, leading to a fundamental misalignment between diffusion mechanisms and the TSF objective, thereby severely impairing performance. To bridge this misalignment, and inspired by the classic Auto-Regressive Moving Average (ARMA) theory, which views time series as continuous sequential progressions evolving from previous data points, we propose a novel Auto-Regressive Moving Diffusion (ARMD) model to first achieve the continuous sequential diffusion-based TSF. Unlike previous methods that start from white Gaussian noise, our model employs chain-based diffusion with priors, accurately modeling the evolution of time series and leveraging intermediate state information to improve forecasting accuracy and stability. Specifically, our approach reinterprets the diffusion process by considering future series as the initial state and historical series as the final state, with intermediate series generated using a sliding-based technique during the forward process. This design aligns the diffusion model's sampling procedure with the forecasting objective, resulting in an unconditional, continuous sequential diffusion TSF model. Extensive experiments conducted on seven widely used datasets demonstrate that our model achieves state-of-the-art performance, significantly outperforming existing diffusion-based TSF models. Our code is available on GitHub: https://github.com/daxin007/ARMD.

📄 PDF Abstract BibTeX arXiv:2412.09328

Code (1)

daxin007/armd 공식 구현 pytorch

Tasks

Time SeriesTime Series Forecasting

Methods 이 논문이 사용한 방법론

ADOPT Please enter a description about the method here
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

An Auto-Regressive Formulation for Smoothing and Moving Mean with Exponentially Tapered Windows

2022-06-29 · Kaan Gokcesu, Hakan Gokcesu

We investigate an auto-regressive formulation for the problem of smoothing time-series by manipulating the inherent objective function of the traditional moving mean smoothers. Not only the auto-regressive smoothers enfo…

Time SeriesTime Series Analysis

Non-autoregressive Conditional Diffusion Models for Time Series Prediction

2023-06-08 · Lifeng Shen, James Kwok

Recently, denoising diffusion models have led to significant breakthroughs in the generation of images, audio and text. However, it is still an open question on how to adapt their strong modeling ability to model time se…

DenoisingOpen-Ended Question AnsweringTime SeriesTime Series Prediction

Autoregressive Moving-average Attention Mechanism for Time Series Forecasting

2024-10-04 · Jiecheng Lu, Xu Han, Yan Sun, Shihao Yang

We propose an Autoregressive (AR) Moving-average (MA) attention structure that can adapt to various linear attention mechanisms, enhancing their ability to capture long-range and local temporal patterns in time series. I…

DecoderTime SeriesTime Series Forecasting

Temporal Clustering of Time Series via Threshold Autoregressive Models: Application to Commodity Prices

2016-05-03 · Sipan Aslan, Ceylan Yozgatligil, Cem Iyigun

This study aimed to find temporal clusters for several commodity prices using the threshold non-linear autoregressive model. It is expected that the process of determining the commodity groups that are time-dependent wil…

ClusteringTime SeriesTime Series Analysis

Diffusion Auto-regressive Transformer for Effective Self-supervised Time Series Forecasting

2024-10-08 · Daoyu Wang, Mingyue Cheng, Zhiding Liu, Qi Liu 외

Self-supervised learning has become a popular and effective approach for enhancing time series forecasting, enabling models to learn universal representations from unlabeled data. However, effectively capturing both the …

DecoderDenoisingSelf-Supervised LearningTime Series+1