TACTiS-2: Better, Faster, Simpler Attentional Copulas for Multivariate Time Series
We introduce a new model for multivariate probabilistic time series prediction, designed to flexibly address a range of tasks including forecasting, interpolation, and their combinations. Building on copula theory, we propose a simplified objective for the recently-introduced transformer-based attentional copulas (TACTiS), wherein the number of distributional parameters now scales linearly with the number of variables instead of factorially. The new objective requires the introduction of a training curriculum, which goes hand-in-hand with necessary changes to the original architecture. We show that the resulting model has significantly better training dynamics and achieves state-of-the-art performance across diverse real-world forecasting tasks, while maintaining the flexibility of prior work, such as seamless handling of unaligned and unevenly-sampled time series. Code is made available at https://github.com/ServiceNow/TACTiS.
Code (1)
Tasks
Time SeriesTime Series PredictionSimilar Papers 제목 키워드 기반
TACTiS: Transformer-Attentional Copulas for Time Series
The estimation of time-varying quantities is a fundamental component of decision making in fields such as healthcare and finance. However, the practical utility of such estimates is limited by how accurately they quantif…
Decision MakingDecoderTime SeriesTime Series Analysis+1The Fragility of the Reverse Facilitation Effect in the Stroop Task: A Dynamic Neurocognitive Model
In typical Stroop experiments, participants perform better when the colors and words are congruent compared to when they are incongruent or neutral. Paradoxically, in some experimental conditions, neutral trials are fast…
Portfolio optimization based on forecasting models using vine copulas: An empirical assessment for the financial crisis
We employ and examine vine copulas in modeling symmetric and asymmetric dependency structures and forecasting financial returns. We analyze the asset allocations performed during the 2008-2009 financial crisis and test d…
Portfolio OptimizationDeep Archimedean Copulas
A central problem in machine learning and statistics is to model joint densities of random variables from data. Copulas are joint cumulative distribution functions with uniform marginal distributions and are used to capt…
Attentional Factorization Machines: Learning the Weight of Feature Interactions via Attention Networks
Factorization Machines (FMs) are a supervised learning approach that enhances the linear regression model by incorporating the second-order feature interactions. Despite effectiveness, FM can be hindered by its modelling…
regression