paper-with-me

Papers

A Time-Series Data Augmentation Model through Diffusion and Transformer Integration

2025-05-01 · Yuren Zhang, Zhongnan Pu, Lei Jing

With the development of Artificial Intelligence, numerous real-world tasks have been accomplished using technology integrated with deep learning. To achieve optimal performance, deep neural networks typically require large volumes of data for training. Although advances in data augmentation have facilitated the acquisition of vast datasets, most of this data is concentrated in domains like images and speech. However, there has been relatively less focus on augmenting time-series data. To address this gap and generate a substantial amount of time-series data, we propose a simple and effective method that combines the Diffusion and Transformer models. By utilizing an adjusted diffusion denoising model to generate a large volume of initial time-step action data, followed by employing a Transformer model to predict subsequent actions, and incorporating a weighted loss function to achieve convergence, the method demonstrates its effectiveness. Using the performance improvement of the model after applying augmented data as a benchmark, and comparing the results with those obtained without data augmentation or using traditional data augmentation methods, this approach shows its capability to produce high-quality augmented data.

📄 PDF Abstract BibTeX arXiv:2505.03790

Code (0)

등록된 구현이 없습니다.

Tasks

Data AugmentationDenoisingTime Series

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Multi-Head Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
Focus 설명 없음

Similar Papers 제목 키워드 기반

DAD4TS: Data-Augmentation-Oriented Diffusion Model for Time-Series Forecasting with Small-Scale Data

2026-05-18 · Masahiro Suzuki, Bohui Xia, Hiroto Yamamoto, Masanori Miyahara arxiv

Small-scale data is a critical problem in time-series forecasting tasks. Data augmentation is an effective strategy for this task, but it has a limitation in generating meaningful data. To address this limitation, we pro…

Reinforcement LearningData Augmentation

DiffStyleTS: Diffusion Model for Style Transfer in Time Series

2025-10-13 · Mayank Nagda, Phil Ostheimer, Justus Arweiler, Indra Jungjohann 외 arxiv

Style transfer combines the content of one signal with the style of another. It supports applications such as data augmentation and scenario simulation, helping machine learning models generalize in data-scarce domains. …

Anomaly DetectionData AugmentationStyle Transfer

fMRI-Diffusion: Generating fMRI Time Series Via a Temporal Transformer Diffusion Model for Major Depressive Disorder Diagnosis

2026-05-22 · Muhammad Asif Hasan, Yanming Zhu, Xuefei Yin, Alan Wee-Chung Liew arxiv

Diagnosing Major Depressive Disorder (MDD) from functional magnetic resonance imaging (fMRI) using functional connectivity (FC) analysis requires large amounts of labeled data that are scarce in clinical settings. Existi…

Leveraging Priors via Diffusion Bridge for Time Series Generation

2024-08-13 · Jinseong Park, Seungyun Lee, Woojin Jeong, Yujin Choi 외

Time series generation is widely used in real-world applications such as simulation, data augmentation, and hypothesis test techniques. Recently, diffusion models have emerged as the de facto approach for time series gen…

Data AugmentationTime SeriesTime Series Generation

OATS: Online Data Augmentation for Time Series Foundation Models

2026-01-26 · Junwei Deng, Chang Xu, Jiaqi W. Ma, Ming Jin 외 arxiv

Time Series Foundation Models (TSFMs) are a powerful paradigm for time series analysis and are often enhanced by synthetic data augmentation to improve the training data quality. Existing augmentation methods, however, t…

Time Series AnalysisData Augmentation