Representation Learning of Multivariate Time Series using Attention and Adversarial Training
A critical factor in trustworthy machine learning is to develop robust representations of the training data. Only under this guarantee methods are legitimate to artificially generate data, for example, to counteract imbalanced datasets or provide counterfactual explanations for blackbox decision-making systems. In recent years, Generative Adversarial Networks (GANs) have shown considerable results in forming stable representations and generating realistic data. While many applications focus on generating image data, less effort has been made in generating time series data, especially multivariate signals. In this work, a Transformer-based autoencoder is proposed that is regularized using an adversarial training scheme to generate artificial multivariate time series signals. The representation is evaluated using t-SNE visualizations, Dynamic Time Warping (DTW) and Entropy scores. Our results indicate that the generated signals exhibit higher similarity to an exemplary dataset than using a convolutional network approach.
Code (1)
Tasks
counterfactualDecision MakingDynamic Time WarpingRepresentation LearningTime SeriesMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
STING: Self-attention based Time-series Imputation Networks using GAN
Time series data are ubiquitous in real-world applications. However, one of the most common problems is that the time series data could have missing values by the inherent nature of the data collection process. So imputi…
ImputationMissing ValuesTime SeriesTime Series AnalysisExpressing Multivariate Time Series as Graphs with Time Series Attention Transformer
A reliable and efficient representation of multivariate time series is crucial in various downstream machine learning tasks. In multivariate time series forecasting, each variable depends on its historical values and the…
Multivariate Time Series ForecastingRepresentation LearningTime SeriesTime Series Analysis+1GenAD: General Representations of Multivariate Time Series for Anomaly Detection
Anomaly Detection(AD) for multivariate time series is an active area in machine learning, with critical applications in Information Technology system management, Spacecraft Health monitoring, Multi-Robot Systems detectio…
Anomaly DetectionManagementTime SeriesTime Series Analysis+1Adversarial Attacks on Multivariate Time Series
Classification models for the multivariate time series have gained significant importance in the research community, but not much research has been done on generating adversarial samples for these models. Such samples of…
ClassificationDynamic Time WarpingGeneral ClassificationTime Series+2Dynamic Hypergraph Representation Learning for Multivariate Time Series without Prior Knowledge
Hypergraphs have the capacity to capture higher-dimensional relationships among entities across various domains, making them a subject of growing interest within the research community for understanding the structure and…
Representation LearningCommunity Detection