How Features Benefit: Parallel Series Embedding for Multivariate Time Series Forecasting with Transformer
Forecasting time series is an engaging and vital mathematical topic. Theories and applications in related fields have been studied for decades, and deep learning has provided reliable tools in recent years. Transformer, capable to capture longer sequence dependencies, was exploited as a powerful architecture in time series forecasting. While existing work majorly contributed to breaking memory bottleneck of Trasnformer, how to effectively leverage multivariate time series remains barely focused. In this work, a novel architecture utilizing a primary Transformer is proposed to conduct multivariate time series predictions. Our proposed architecture has two main advantages. Firstly, it accurately predicts multivariate time series with shorter or longer sequence lengths and steps. We benchmark our proposed model with various baseline architectures on realworld datasets, and our model improved their performances significantly. Secondly, it can easily be leveraged in Transformerbased variants,
Code (1)
Tasks
Multivariate Time Series ForecastingTime SeriesTime Series ForecastingSimilar Papers 제목 키워드 기반
EdgeConvFormer: Dynamic Graph CNN and Transformer based Anomaly Detection in Multivariate Time Series
Transformer-based models for anomaly detection in multivariate time series can benefit from the self-attention mechanism due to its advantage in modeling long-term dependencies. However, Transformer-based anomaly detecti…
Anomaly DetectionTime SeriesRoLA: A Real-Time Online Lightweight Anomaly Detection System for Multivariate Time Series
A multivariate time series refers to observations of two or more variables taken from a device or a system simultaneously over time. There is an increasing need to monitor multivariate time series and detect anomalies in…
Anomaly DetectionTime SeriesTime Series Anomaly DetectionContrastive Representation Learning for Predicting Solar Flares from Extremely Imbalanced Multivariate Time Series Data
Major solar flares are abrupt surges in the Sun's magnetic flux, presenting significant risks to technological infrastructure. In view of this, effectively predicting major flares from solar active region magnetic field …
Maximum SeparationRepresentation LearningSolar Flare PredictionTime Series+1MTS2Graph: Interpretable Multivariate Time Series Classification with Temporal Evolving Graphs
Conventional time series classification approaches based on bags of patterns or shapelets face significant challenges in dealing with a vast amount of feature candidates from high-dimensional multivariate data. In contra…
Graph EmbeddingTime SeriesTime Series ClassificationUsing Pre-trained LLMs for Multivariate Time Series Forecasting
Pre-trained Large Language Models (LLMs) encapsulate large amounts of knowledge and take enormous amounts of compute to train. We make use of this resource, together with the observation that LLMs are able to transfer kn…
DecoderMultivariate Time Series ForecastingTime SeriesTime Series Forecasting