paper-with-me

홈 › Papers

A Multi-Task Learning Approach to Linear Multivariate Forecasting

2025-02-05 · Liran Nochumsohn, Hedi Zisling, Omri Azencot

Accurate forecasting of multivariate time series data is important in many engineering and scientific applications. Recent state-of-the-art works ignore the inter-relations between variates, using their model on each variate independently. This raises several research questions related to proper modeling of multivariate data. In this work, we propose to view multivariate forecasting as a multi-task learning problem, facilitating the analysis of forecasting by considering the angle between task gradients and their balance. To do so, we analyze linear models to characterize the behavior of tasks. Our analysis suggests that tasks can be defined by grouping similar variates together, which we achieve via a simple clustering that depends on correlation-based similarities. Moreover, to balance tasks, we scale gradients with respect to their prediction error. Then, each task is solved with a linear model within our MTLinear framework. We evaluate our approach on challenging benchmarks in comparison to strong baselines, and we show it obtains on-par or better results on multivariate forecasting problems. The implementation is available at: https://github.com/azencot-group/MTLinear

📄 PDF Abstract BibTeX arXiv:2502.03571

Code (1)

azencot-group/mtlinear 공식 구현 pytorch

Tasks

Multi-Task Learning

Similar Papers 제목 키워드 기반

Temporal Latent Auto-Encoder: A Method for Probabilistic Multivariate Time Series Forecasting

2021-01-25 · Nam Nguyen, Brian Quanz

Probabilistic forecasting of high dimensional multivariate time series is a notoriously challenging task, both in terms of computational burden and distribution modeling. Most previous work either makes simple distributi…

DecoderDeep LearningMultivariate Time Series ForecastingTime Series+2

Multivariate Online Linear Regression for Hierarchical Forecasting

2024-02-22 · Massil Hihat, Guillaume Garrigos, Adeline Fermanian, Simon Bussy

In this paper, we consider a deterministic online linear regression model where we allow the responses to be multivariate. To address this problem, we introduce MultiVAW, a method that extends the well-known Vovk-Azoury-…

regression

DSANet: Dual Self-Attention Network for Multivariate Time Series Forecasting

2019-11-03 · CIKM ’19, November 3–7, 2019, Beijing, China 2019 11 · Siteng Huang Donglin Wang∗

Multivariate time series forecasting has attracted wide attention in areas, such as system, traffic, and finance. The difficulty of the task lies in that traditional methods fail to capture complicated nonlinear dependen…

Multivariate Time Series ForecastingTime SeriesTime Series AnalysisTime Series Forecasting

OLinear: A Linear Model for Time Series Forecasting in Orthogonally Transformed Domain

2025-05-12 · Wenzhen Yue, Yong liu, Haoxuan Li, Hao Wang 외

This paper presents $\mathbf{OLinear}$, a $\mathbf{linear}$-based multivariate time series forecasting model that operates in an $\mathbf{o}$rthogonally transformed domain. Recent forecasting models typically adopt the t…

Multivariate Time Series ForecastingRepresentation LearningTime SeriesTime Series Forecasting

vLinear: A Powerful Linear Model for Multivariate Time Series Forecasting

2026-01-20 · Wenzhen Yue, Ruohao Guo, Ji Shi, Zihan Hao 외 arxiv

In this paper, we present \textbf{vLinear}, an effective yet efficient \textbf{linear}-based multivariate time series forecaster featuring two components: the \textbf{v}ecTrans module and the WFMLoss objective. Many stat…

Multivariate Time Series Forecasting