Non-autoregressive Conditional Diffusion Models for Time Series Prediction
Recently, denoising diffusion models have led to significant breakthroughs in the generation of images, audio and text. However, it is still an open question on how to adapt their strong modeling ability to model time series. In this paper, we propose TimeDiff, a non-autoregressive diffusion model that achieves high-quality time series prediction with the introduction of two novel conditioning mechanisms: future mixup and autoregressive initialization. Similar to teacher forcing, future mixup allows parts of the ground-truth future predictions for conditioning, while autoregressive initialization helps better initialize the model with basic time series patterns such as short-term trends. Extensive experiments are performed on nine real-world datasets. Results show that TimeDiff consistently outperforms existing time series diffusion models, and also achieves the best overall performance across a variety of the existing strong baselines (including transformers and FiLM).
Code (0)
등록된 구현이 없습니다.
Tasks
DenoisingOpen-Ended Question AnsweringTime SeriesTime Series PredictionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
TIMED: Adversarial and Autoregressive Refinement of Diffusion-Based Time Series Generation
Generating high-quality synthetic time series is a fundamental yet challenging task across domains such as forecasting and anomaly detection, where real data can be scarce, noisy, or costly to collect. Unlike static data…
Anomaly DetectionCSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputation
The imputation of missing values in time series has many applications in healthcare and finance. While autoregressive models are natural candidates for time series imputation, score-based diffusion models have recently o…
Audio SynthesisImage GenerationImputationMissing Values+2UTSD: Unified Time Series Diffusion Model
Transformer-based architectures have achieved unprecedented success in time series analysis. However, facing the challenge of across-domain modeling, existing studies utilize statistical prior as prompt engineering fails…
DenoisingmodelPrompt EngineeringTime Series+2SutraNets: Sub-series Autoregressive Networks for Long-Sequence, Probabilistic Forecasting
We propose SutraNets, a novel method for neural probabilistic forecasting of long-sequence time series. SutraNets use an autoregressive generative model to factorize the likelihood of long sequences into products of cond…
Time SeriesUniGenX: Unified Generation of Sequence and Structure with Autoregressive Diffusion
Unified generation of sequence and structure for scientific data (e.g., materials, molecules, proteins) is a critical task. Existing approaches primarily rely on either autoregressive sequence models or diffusion models,…
Text Generation