A Multi-Task Learning Approach to Linear Multivariate Forecasting
Accurate forecasting of multivariate time series data is important in many engineering and scientific applications. Recent state-of-the-art works ignore the inter-relations between variates, using their model on each variate independently. This raises several research questions related to proper modeling of multivariate data. In this work, we propose to view multivariate forecasting as a multi-task learning problem, facilitating the analysis of forecasting by considering the angle between task gradients and their balance. To do so, we analyze linear models to characterize the behavior of tasks. Our analysis suggests that tasks can be defined by grouping similar variates together, which we achieve via a simple clustering that depends on correlation-based similarities. Moreover, to balance tasks, we scale gradients with respect to their prediction error. Then, each task is solved with a linear model within our MTLinear framework. We evaluate our approach on challenging benchmarks in comparison to strong baselines, and we show it obtains on-par or better results on multivariate forecasting problems. The implementation is available at: https://github.com/azencot-group/MTLinear
Code (1)
Tasks
Multi-Task LearningSimilar Papers 제목 키워드 기반
Temporal Latent Auto-Encoder: A Method for Probabilistic Multivariate Time Series Forecasting
Probabilistic forecasting of high dimensional multivariate time series is a notoriously challenging task, both in terms of computational burden and distribution modeling. Most previous work either makes simple distributi…
DecoderDeep LearningMultivariate Time Series ForecastingTime Series+2Multivariate Online Linear Regression for Hierarchical Forecasting
In this paper, we consider a deterministic online linear regression model where we allow the responses to be multivariate. To address this problem, we introduce MultiVAW, a method that extends the well-known Vovk-Azoury-…
regressionDSANet: Dual Self-Attention Network for Multivariate Time Series Forecasting
Multivariate time series forecasting has attracted wide attention in areas, such as system, traffic, and finance. The difficulty of the task lies in that traditional methods fail to capture complicated nonlinear dependen…
Multivariate Time Series ForecastingTime SeriesTime Series AnalysisTime Series ForecastingOLinear: A Linear Model for Time Series Forecasting in Orthogonally Transformed Domain
This paper presents $\mathbf{OLinear}$, a $\mathbf{linear}$-based multivariate time series forecasting model that operates in an $\mathbf{o}$rthogonally transformed domain. Recent forecasting models typically adopt the t…
Multivariate Time Series ForecastingRepresentation LearningTime SeriesTime Series ForecastingvLinear: A Powerful Linear Model for Multivariate Time Series Forecasting
In this paper, we present \textbf{vLinear}, an effective yet efficient \textbf{linear}-based multivariate time series forecaster featuring two components: the \textbf{v}ecTrans module and the WFMLoss objective. Many stat…
Multivariate Time Series Forecasting