paper-with-me

홈 › Papers

Diversified Scaling Inference in Time Series Foundation Models

2026-01-24 · Ruijin Hua, Zichuan Liu, Kun Zhang, Yiyuan Yang arxiv

The advancement of Time Series Foundation Models (TSFMs) has been driven primarily by large-scale pre-training, but inference-time compute potential remains largely untapped. This work systematically investigates two questions: how do TSFMs behave under standard sampling-based inference scaling, and can controlled sampling diversity enhance performance? We first examine the properties of TSFMs under standard sampling often fail to adhere to scaling laws due to insufficient exploration of the solution space. Building on this, we then delve into diversified inference scaling via tailored time series perturbations to expand the generative distribution's support. We theoretically analyze the diversity-fidelity trade-off and derive a critical sample threshold for diversified sampling to outperform standard sampling. Extensive experiments across various TSFMs and datasets show proper diversified inference scaling yields substantial performance gains without parameter updates, establishing inference design as a critical, compute-efficient dimension of TSFM optimization. As an application, we propose RobustMSE, a rigorous metric to quantify the headroom performance of TSFM under a fixed budget. Overall, our findings clarify these factor interactions, enabling reliable performance via diverse large-scale inference time series in parallel environments without re-training TSFMs.

📄 PDF Abstract BibTeX arXiv:2601.17376

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Reverso: Efficient Time Series Foundation Models for Zero-shot Forecasting

2026-02-19 · Xinghong Fu, Yanhong Li, Georgios Papaioannou, Yoon Kim arxiv

Learning time series foundation models has been shown to be a promising approach for zero-shot time series forecasting across diverse time series domains. Insofar as scaling has been a critical driver of performance of f…

Time Series ForecastingData Augmentation

Mamba4Cast: Efficient Zero-Shot Time Series Forecasting with State Space Models

2024-10-12 · Sathya Kamesh Bhethanabhotla, Omar Swelam, Julien Siems, David Salinas 외

This paper introduces Mamba4Cast, a zero-shot foundation model for time series forecasting. Based on the Mamba architecture and inspired by Prior-data Fitted Networks (PFNs), Mamba4Cast generalizes robustly across divers…

AutoMLMambaState Space ModelsTime Series+1

Timer-S1: A Billion-Scale Time Series Foundation Model with Serial Scaling

2026-03-05 · Yong Liu, Xingjian Su, Shiyu Wang, Haoran Zhang 외 arxiv

We introduce Timer-S1, a strong Mixture-of-Experts (MoE) time series foundation model with 8.3B total parameters, 0.75B activated parameters for each token, and a context length of 11.5K. To overcome the scalability bott…

Data Augmentation

The Few Govern the Many:Unveiling Few-Layer Dominance for Time Series Models

2025-11-10 · Xin Qiu, Junlong Tong, Yirong Sun, Yunpu Ma 외 arxiv

Large-scale models are at the forefront of time series (TS) forecasting, dominated by two paradigms: fine-tuning text-based Large Language Models (LLM4TS) and training Time Series Foundation Models (TSFMs) from scratch. …

Scaling-laws for Large Time-series Models

2024-05-22 · Thomas D. P. Edwards, James Alvey, Justin Alsing, Nam H. Nguyen 외

Scaling laws for large language models (LLMs) have provided useful guidance in training ever larger models for predictable performance gains. Time series forecasting shares a similar sequential structure to language, and…

DecoderTime SeriesTime Series Forecasting