paper-with-me

Papers

TimeRAG: BOOSTING LLM Time Series Forecasting via Retrieval-Augmented Generation

2024-12-21 · Silin Yang, Dong Wang, Haoqi Zheng, Ruochun Jin

Although the rise of large language models (LLMs) has introduced new opportunities for time series forecasting, existing LLM-based solutions require excessive training and exhibit limited transferability. In view of these challenges, we propose TimeRAG, a framework that incorporates Retrieval-Augmented Generation (RAG) into time series forecasting LLMs, which constructs a time series knowledge base from historical sequences, retrieves reference sequences from the knowledge base that exhibit similar patterns to the query sequence measured by Dynamic Time Warping (DTW), and combines these reference sequences and the prediction query as a textual prompt to the time series forecasting LLM. Experiments on datasets from various domains show that the integration of RAG improved the prediction accuracy of the original model by 2.97% on average.

📄 PDF Abstract BibTeX arXiv:2412.16643

Code (0)

등록된 구현이 없습니다.

Tasks

Dynamic Time WarpingRAGRetrievalRetrieval-augmented GenerationTime SeriesTime Series Forecasting

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Residual Connection 설명 없음
Adam 설명 없음
Weight Decay 설명 없음
Multi-Head Attention 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
WordPiece 설명 없음

Similar Papers 제목 키워드 기반

Boosted Embeddings for Time Series Forecasting

2021-04-10 · Sankeerth Rao Karingula, Nandini Ramanan, Rasool Tahmasbi, Mehrnaz Amjadi 외

Time series forecasting is a fundamental task emerging from diverse data-driven applications. Many advanced autoregressive methods such as ARIMA were used to develop forecasting models. Recently, deep learning based meth…

Deep LearningTime SeriesTime Series AnalysisTime Series Forecasting

Retrieval Augmented Time Series Forecasting

2024-11-12 · Kutay Tire, Ege Onur Taga, Muhammed Emrullah Ildız, Samet Oymak

Retrieval-augmented generation (RAG) is a central component of modern LLM systems, particularly in scenarios where up-to-date information is crucial for accurately responding to user queries or when queries exceed the sc…

RAGRetrievalRetrieval-augmented GenerationTime Series+1

Retrieval Based Time Series Forecasting

2022-09-27 · Baoyu Jing, Si Zhang, Yada Zhu, Bin Peng 외

Time series data appears in a variety of applications such as smart transportation and environmental monitoring. One of the fundamental problems for time series analysis is time series forecasting. Despite the success of…

ImputationRetrievalTime SeriesTime Series Analysis+1

Semantics-Enhanced Retrieval-Augmented Time Series Forecasting

2026-06-12 · Shiqiao Zhou, Zipeng Wu, Holger Schöner, Edouard Fouché 외 arxiv

Time series forecasting models often benefit from historical patterns. Inspired by Retrieval-Augmented Generation (RAG), recent research explored retrieving relevant historical time series segments to enhance forecasting…

Time Series Forecasting

Boosted Ensemble Learning based on Randomized NNs for Time Series Forecasting

2022-03-02 · Grzegorz Dudek

Time series forecasting is a challenging problem particularly when a time series expresses multiple seasonality, nonlinear trend and varying variance. In this work, to forecast complex time series, we propose ensemble le…

Ensemble LearningTime SeriesTime Series AnalysisTime Series Forecasting