paper-with-me

Papers

FlexTSF: A Universal Forecasting Model for Time Series with Variable Regularities

2024-10-30 · Jingge Xiao, Yile Chen, Gao Cong, Wolfgang Nejdl, Simon Gottschalk

Developing a foundation model for time series forecasting across diverse domains has attracted significant attention in recent years. Existing works typically assume regularly sampled, well-structured data, limiting their applicability to more generalized scenarios where time series often contain missing values, unequal sequence lengths, and irregular time intervals between measurements. To cover diverse domains and handle variable regularities, we propose FlexTSF, a universal time series forecasting model that possesses better generalization and natively support both regular and irregular time series. FlexTSF produces forecasts in an autoregressive manner and incorporates three novel designs: VT-Norm, a normalization strategy to ablate data domain barriers, IVP Patcher, a patching module to learn representations from flexibly structured time series, and LED attention, an attention mechanism to seamlessly integrate these two and propagate forecasts with awareness of domain and time information. Experiments on 12 datasets show that FlexTSF outperforms state-of-the-art forecasting models respectively designed for regular and irregular time series. Furthermore, after self-supervised pre-training, FlexTSF shows exceptional performance in both zero-shot and few-show settings for time series forecasting.

📄 PDF Abstract BibTeX arXiv:2410.23160

Code (1)

jingge326/flextsf 공식 구현 pytorch

Tasks

Irregular Time SeriesMissing ValuesTime SeriesTime Series Forecasting

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Patching Activation patching studies the model's computation by altering its latent representations, the token embeddings in transformer-based language models, during the inference process

Similar Papers 제목 키워드 기반

Timer-XL: Long-Context Transformers for Unified Time Series Forecasting

2024-10-07 · Yong liu, Guo Qin, Xiangdong Huang, Jianmin Wang 외

We present Timer-XL, a generative Transformer for unified time series forecasting. To uniformly predict 1D and 2D time series, we generalize next token prediction, predominantly adopted for causal generation of 1D sequen…

Time SeriesTime Series Forecasting

Unified Training of Universal Time Series Forecasting Transformers

2024-02-04 · Gerald Woo, Chenghao Liu, Akshat Kumar, Caiming Xiong 외

Deep learning for time series forecasting has traditionally operated within a one-model-per-dataset framework, limiting its potential to leverage the game-changing impact of large pre-trained models. The concept of unive…

Time SeriesTime Series Forecasting

Signals, Concepts, and Laws: Toward Universal, Explainable Time-Series Forecasting

2025-08-02 · Hongwei Ma, Junbin Gao, Minh-Ngoc Tran arxiv

Accurate, explainable and physically credible forecasting remains a persistent challenge for multivariate time-series whose statistical properties vary across domains. We propose DORIC, a Domain-Universal, ODE-Regularize…

Cross-LKTCN: Modern Convolution Utilizing Cross-Variable Dependency for Multivariate Time Series Forecasting Dependency for Multivariate Time Series Forecasting

2023-06-04 · Donghao Luo, Xue Wang

The past few years have witnessed the rapid development in multivariate time series forecasting. The key to accurate forecasting results is capturing the long-term dependency between each time step (cross-time dependency…

Multivariate Time Series ForecastingTime SeriesTime Series Forecasting

FDNet: Focal Decomposed Network for Efficient, Robust and Practical Time Series Forecasting

2023-06-19 · Li Shen, Yuning Wei, Yangzhu Wang, Huaxin Qiu

This paper presents FDNet: a Focal Decomposed Network for efficient, robust and practical time series forecasting. We break away from conventional deep time series forecasting formulas which obtain prediction results fro…

Inductive BiasTime SeriesTime Series Forecasting