paper-with-me

홈 › Papers

TiRex-2: Generalizing TiRex to Multivariate Data and Streaming

2026-07-01 · Patrick Podest, Marco Pichler, Elias Bürger, Levente Zólyomi, Bernhard Voggenberger, Wilhelm Berghammer, Daniel Klotz, Sebastian Böck, Günter Klambauer, Sepp Hochreiter arxiv

We introduce TiRex-2, a recurrent xLSTM-based time series foundation model that generalizes the univariate TiRex to multivariate forecasting with both past and future covariates. Real-world forecasting is inherently sequential: observations arrive continuously, variables evolve jointly, and a subset of covariates is known ahead of time. Existing Transformer-based time series foundation models capture cross-variate dependencies but incur quadratic complexity in context length and require full-history recomputation as new observations arrive. TiRex-2 addresses these limitations through a memory-centric recurrent design that operates at constant per-patch cost under streaming. The model combines a bidirectional time mixer with an asymmetric grouped-attention variate mixer, enabling the integration of future-known covariates while preserving strict causality over target variables. To our knowledge, this is the first time series foundation model that achieves this combination of properties. To support scalable multivariate pretraining, we propose a synthetic coupling pipeline that composes diverse multivariate samples on the fly from large univariate corpora. Empirically, TiRex-2 achieves state-of-the-art zero-shot performance on GIFT-Eval and fev-bench, remains stable when streamed to arbitrary context lengths, and maintains constant inference cost per patch. The model uses 38.4M active parameters in univariate mode, with an additional 44.1M parameters activated for multivariate forecasting.

📄 PDF Abstract BibTeX arXiv:2607.01204

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

TiRex: Zero-Shot Forecasting Across Long and Short Horizons with Enhanced In-Context Learning

2025-05-29 · Andreas Auer, Patrick Podest, Daniel Klotz, Sebastian Böck 외

In-context learning, the ability of large language models to perform tasks using only examples provided in the prompt, has recently been adapted for time series forecasting. This paradigm enables zero-shot prediction, wh…

In-Context LearningState Space ModelsTime SeriesTime Series Forecasting

The Information Retrieval Experiment Platform

2023-05-30 · Maik Fröbe, Jan Heinrich Reimer, Sean MacAvaney, Niklas Deckers 외

We integrate ir_datasets, ir_measures, and PyTerrier with TIRA in the Information Retrieval Experiment Platform (TIREx) to promote more standardized, reproducible, scalable, and even blinded retrieval experiments. Standa…

CPUInformation RetrievalRetrieval

Multiple Different Black Box Explanations for Image Classifiers

2023-09-25 · Hana Chockler, David A. Kelly, Daniel Kroening

Existing explanation tools for image classifiers usually give only a single explanation for an image's classification. For many images, however, both humans and image classifiers accept more than one explanation for the …

SEREP: Semantic Facial Expression Representation for Robust In-the-Wild Capture and Retargeting

2024-12-18 · Arthur Josi, Luiz Gustavo Hafemann, Abdallah Dib, Emeline Got 외

Monocular facial performance capture in-the-wild is challenging due to varied capture conditions, face shapes, and expressions. Most current methods rely on linear 3D Morphable Models, which represent facial expressions …

Domain Adaptation

Set-Encoder: Permutation-Invariant Inter-Passage Attention for Listwise Passage Re-Ranking with Cross-Encoders

2024-04-10 · Ferdinand Schlatt, Maik Fröbe, Harrisen Scells, Shengyao Zhuang 외

Existing cross-encoder models can be categorized as pointwise, pairwise, or listwise. Pairwise and listwise models allow passage interactions, which typically makes them more effective than pointwise models but less effi…

Passage Re-RankingRe-Ranking