paper-with-me

Papers

Align-RAG: Alignment Is All You Need for TSFM In-Context Learning

2026-08-06 · Mohammad Asadi, Soheil Hor, Bardiya Akhbari, Jack W. O'Sullivan, Tahoura Nedaee, Layne C. Price, Raviteja Anantha, Euan Ashley, Ehsan Adeli arxiv

Retrieval-augmented forecasting promises to adapt frozen Time Series Foundation Models (TSFMs) to new domains without fine-tuning, but recent methods typically rely on learned fusion modules, i.e., trained adapters that merge retrieved examples into the backbone's forecast, based on the assumption that frozen backbones cannot dynamically incorporate retrieved context on their own. We show this assumption is unnecessary. We introduce Align-RAG, a training-free method that applies a closed-form per-pair amplitude rescaling and integer-lag phase shift to retrieved past-future windows before they enter a frozen backbone's context. With no learned parameters, Align-RAG outperforms the state-of-the-art trained retrieval adapter on a frozen Chronos-Bolt on all seven datasets of the standard benchmark (avg -3.75% MSE), showing that the gains previously attributed to learned fusion are recoverable without any training. Align-RAG further improves zero-shot MSE on four additional frozen TSFMs with various architectures by 2.5% to 13.7% per backbone with no per-backbone tuning. To probe why alignment helps, we compare the frozen backbone's prediction shift under aligned demonstrations to the closed-form ridge prediction shift on the same pairs. We find that aligned demonstrations induce prediction shifts that track a closed-form ridge predictor on the same pairs, with a future-shuffle control ruling out a futures-averaging account. Together, these results indicate that frozen TSFMs already support dynamic in-context use of retrievals, and that closed-form alignment should be the default baseline for retrieval-augmented forecasting before any fusion module is trained. Code available at: https://github.com/masadi-99/align-rag

📄 PDF Abstract BibTeX arXiv:2608.05571

Code (2)

arxivsub/arXivSub_daily_arxiv ★ 4
masadi-99/align-rag ★ 1

Similar Papers 제목 키워드 기반

Cross-device Zero-shot Label Transfer via Alignment of Time Series Foundation Model Embeddings

2025-08-22 · Neal G. Ravindra, Arijit Sehanobish arxiv

High-quality, medically validated labels exist for clinical actigraphy data but not for ubiquitous consumer wearables like the Apple Watch. Manually labeling wearables data is expensive and doesn't scale. This paper offe…

TS-Reasoner: Aligning Time Series Foundation Models with LLM Reasoning

2025-10-03 · Fangxu Yu, Hongyu Zhao, Tianyi Zhou arxiv

Time series reasoning is crucial to decision-making in diverse domains, including finance, energy, and scientific discovery. While existing time series foundation models (TSFMs) can capture low-level dynamic patterns and…

TSFM in-context learning for time-series classification of bearing-health status

2025-11-19 · Michel Tokic, Slobodan Djukanović, Anja von Beuningen, Cheng Feng arxiv

We introduce a classification method based on in-context learning using time-series foundation models (TSFMs). We demonstrate how data not included in the TSFM training can be classified without fine-tuning the foundatio…

Estimating Time Series Foundation Model Transferability via In-Context Learning

2025-09-28 · Qingren Yao, Ming Jin, Chengqi Zhang, Chao-Han Huck Yang 외 arxiv

Time series foundation models (TSFMs) offer strong zero-shot forecasting via large-scale pre-training, yet fine-tuning remains critical for boosting performance in domains with limited public data. With the growing numbe…

Distilling Time Series Foundation Models for Efficient Forecasting

2026-01-19 · Yuqi Li, Kuiye Ding, Chuanguang Yang, Szu-Yu Chen 외 arxiv

Time Series foundation models (TSFMs) deliver strong forecasting performance through large-scale pretraining, but their large parameter sizes make deployment costly. While knowledge distillation offers a natural and effe…

Time Series ForecastingKnowledge DistillationModel Compression