paper-with-me

Papers

Time-series Transformer Generative Adversarial Networks

2022-05-23 · Padmanaba Srinivasan, William J. Knottenbelt

Many real-world tasks are plagued by limitations on data: in some instances very little data is available and in others, data is protected by privacy enforcing regulations (e.g. GDPR). We consider limitations posed specifically on time-series data and present a model that can generate synthetic time-series which can be used in place of real data. A model that generates synthetic time-series data has two objectives: 1) to capture the stepwise conditional distribution of real sequences, and 2) to faithfully model the joint distribution of entire real sequences. Autoregressive models trained via maximum likelihood estimation can be used in a system where previous predictions are fed back in and used to predict future ones; in such models, errors can accrue over time. Furthermore, a plausible initial value is required making MLE based models not really generative. Many downstream tasks learn to model conditional distributions of the time-series, hence, synthetic data drawn from a generative model must satisfy 1) in addition to performing 2). We present TsT-GAN, a framework that capitalises on the Transformer architecture to satisfy the desiderata and compare its performance against five state-of-the-art models on five datasets and show that TsT-GAN achieves higher predictive performance on all datasets.

📄 PDF Abstract BibTeX arXiv:2205.11164

Code (5)

jsyoon0823/TimeGAN 공식 구현 tf
AlanDongMu/TimeGAN_PytorchRebuild pytorch
MindCode-4/code-5/tree/main/time_series_transformer mindspore
flaviagiammarino/time-gan-tensorflow tf
pwc-1/Paper-10/tree/main/time_series_transformer mindspore

Tasks

Question AnsweringTime SeriesTime Series AnalysisTime Series Generation

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Adam 설명 없음

Similar Papers 제목 키워드 기반

GAT-GAN : A Graph-Attention-based Time-Series Generative Adversarial Network

2023-06-03 · Srikrishna Iyer, Teng Teck Hou

Generative Adversarial Networks (GANs) have proven to be a powerful tool for generating realistic synthetic data. However, traditional GANs often struggle to capture complex relationships between features which results i…

Generative Adversarial NetworkGraph AttentionTime Series

TTS-GAN: A Transformer-based Time-Series Generative Adversarial Network

2022-02-06 · Xiaomin Li, Vangelis Metsis, Huangyingrui Wang, Anne Hee Hiong Ngu

Signal measurements appearing in the form of time series are one of the most common types of data used in medical machine learning applications. However, such datasets are often small, making the training of deep neural …

Data AugmentationDimensionality ReductionGenerative Adversarial NetworkTime Series+1

Transformer-based conditional generative adversarial network for multivariate time series generation

2022-10-05 · Abdellah Madane, Mohamed-djallel Dilmi, Florent Forest, Hanane Azzag 외

Conditional generation of time-dependent data is a task that has much interest, whether for data augmentation, scenario simulation, completing missing data, or other purposes. Recent works proposed a Transformer-based Ti…

Data AugmentationGenerative Adversarial NetworkTime SeriesTime Series Analysis+1

Adversarial Sparse Transformer for Time Series Forecasting

2020-12-01 · NeurIPS 2020 12 · Sifan Wu, Xi Xiao, Qianggang Ding, Peilin Zhao 외

Many approaches have been proposed for time series forecasting, in light of its significance in wide applications including business demand prediction. However, the existing methods suffer from two key limitations. Firs…

Multivariate Time Series ForecastingPredictionProbabilistic Time Series ForecastingTime Series+2

Self-Supervised Temporal Super-Resolution of Energy Data using Generative Adversarial Transformer

2025-08-14 · Xuanhao Mu, Gökhan Demirel, Yuzhe Zhang, Jianlei Liu 외 arxiv

To bridge the temporal granularity gap in energy network design and operation based on Energy System Models, resampling of time series is required. While conventional upsampling methods are computationally efficient, the…