paper-with-me

Papers

A Compact Model for Large-Scale Time Series Forecasting

2025-02-28 · Chin-Chia Michael Yeh, Xiran Fan, Zhimeng Jiang, Yujie Fan, Huiyuan Chen, Uday Singh Saini, Vivian Lai, Xin Dai, Junpeng Wang, Zhongfang Zhuang, Liang Wang, Yan Zheng

Spatio-temporal data, which commonly arise in real-world applications such as traffic monitoring, financial transactions, and ride-share demands, represent a special category of multivariate time series. They exhibit two distinct characteristics: high dimensionality and commensurability across spatial locations. These attributes call for computationally efficient modeling approaches and facilitate the use of univariate forecasting models in a channel-independent fashion. SparseTSF, a recently introduced competitive univariate forecasting model, harnesses periodicity to achieve compactness by concentrating on cross-period dynamics, thereby extending the Pareto frontier with respect to model size and predictive performance. Nonetheless, it underperforms on spatio-temporal data due to an inadequate capture of intra-period temporal dependencies. To address this shortcoming, we propose UltraSTF, which integrates a cross-period forecasting module with an ultra-compact shape bank component. Our model effectively detects recurring patterns in time series through the attention mechanism of the shape bank component, thereby strengthening its ability to learn intra-period dynamics. UltraSTF achieves state-of-the-art performance on the LargeST benchmark while employing fewer than 0.2% of the parameters required by the second-best approaches, thus further extending the Pareto frontier of existing methods.

📄 PDF Abstract BibTeX arXiv:2502.20634

Code (0)

등록된 구현이 없습니다.

Tasks

Time SeriesTime Series Forecasting

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

Harmonic Dataset Distillation for Time Series Forecasting

2026-03-04 · Seungha Hong, Sanghwan Jang, Wonbin Kweon, Suyeon Kim 외 arxiv

Time Series forecasting (TSF) in the modern era faces significant computational and storage cost challenges due to the massive scale of real-world data. Dataset Distillation (DD), a paradigm that synthesizes a small, com…

Time Series Forecasting

Frequency-domain MLPs are More Effective Learners in Time Series Forecasting

2023-11-10 · NeurIPS 2023 11 · Kun Yi, Qi Zhang, Wei Fan, Shoujin Wang 외

Time series forecasting has played the key role in different industrial, including finance, traffic, energy, and healthcare domains. While existing literatures have designed many sophisticated architectures based on RNNs…

Time SeriesTime Series Forecasting

Distilling Time Series Foundation Models for Efficient Forecasting

2026-01-19 · Yuqi Li, Kuiye Ding, Chuanguang Yang, Szu-Yu Chen 외 arxiv

Time Series foundation models (TSFMs) deliver strong forecasting performance through large-scale pretraining, but their large parameter sizes make deployment costly. While knowledge distillation offers a natural and effe…

Time Series ForecastingKnowledge DistillationModel Compression

BALM-TSF: Balanced Multimodal Alignment for LLM-Based Time Series Forecasting

2025-08-30 · Shiqiao Zhou, Holger Schöner, Huanbo Lyu, Edouard Fouché 외 arxiv

Time series forecasting is a long-standing and highly challenging research topic. Recently, driven by the rise of large language models (LLMs), research has increasingly shifted from purely time series methods toward har…

Time Series Forecasting

Renaissance of RNNs in Streaming Clinical Time Series: Compact Recurrence Remains Competitive with Transformers

2025-10-19 · Ran Tong, Jiaqi Liu, Su Liu, Xin Hu 외 arxiv

We present a compact, strictly causal benchmark for streaming clinical time series on the MIT--BIH Arrhythmia Database using per-second heart rate. Two tasks are studied under record-level, non-overlapping splits: near-t…