paper-with-me

Papers

Utilizing Image Transforms and Diffusion Models for Generative Modeling of Short and Long Time Series

2024-10-25 · Ilan Naiman, Nimrod Berman, Itai Pemper, Idan Arbiv, Gal Fadlon, Omri Azencot

Lately, there has been a surge in interest surrounding generative modeling of time series data. Most existing approaches are designed either to process short sequences or to handle long-range sequences. This dichotomy can be attributed to gradient issues with recurrent networks, computational costs associated with transformers, and limited expressiveness of state space models. Towards a unified generative model for varying-length time series, we propose in this work to transform sequences into images. By employing invertible transforms such as the delay embedding and the short-time Fourier transform, we unlock three main advantages: i) We can exploit advanced diffusion vision models; ii) We can remarkably process short- and long-range inputs within the same framework; and iii) We can harness recent and established tools proposed in the time series to image literature. We validate the effectiveness of our method through a comprehensive evaluation across multiple tasks, including unconditional generation, interpolation, and extrapolation. We show that our approach achieves consistently state-of-the-art results against strong baselines. In the unconditional generation tasks, we show remarkable mean improvements of 58.17% over previous diffusion models in the short discriminative score and 132.61% in the (ultra-)long classification scores. Code is at https://github.com/azencot-group/ImagenTime.

📄 PDF Abstract BibTeX arXiv:2410.19538

Code (1)

azencot-group/imagentime pytorch

Tasks

State Space ModelsTime Series

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Network Bending of Diffusion Models for Audio-Visual Generation

2024-06-28 · Luke Dzwonczyk, Carmine Emanuele Cella, David Ban

In this paper we present the first steps towards the creation of a tool which enables artists to create music visualizations using pre-trained, generative, machine learning models. First, we investigate the application o…

Image Generation

Score-Based Generative Modeling through Stochastic Differential Equations

2020-11-26 · ICLR 2021 1 · Yang song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar 외

Creating noise from data is easy; creating data from noise is generative modeling. We present a stochastic differential equation (SDE) that smoothly transforms a complex data distribution to a known prior distribution by…

ColorizationDensity EstimationImage GenerationImage Inpainting+1

Generative Modeling via Kernelized Stochastic Interpolants

2026-02-23 · Florentin Coeurdoux, Etienne Lempereur, Nathanaël Cuvelle-Magar, Stéphane Mallat 외 arxiv

We develop a kernel method for generative modeling within the stochastic interpolant framework, replacing neural network training with linear systems. The drift of the generative SDE is $\hat b_t(x) = \nablaφ(x)^\topη_t$…

Image Generation

Can Generative Geospatial Diffusion Models Excel as Discriminative Geospatial Foundation Models?

2025-03-10 · Yuru Jia, Valerio Marsocci, Ziyang Gong, Xue Yang 외

Self-supervised learning (SSL) has revolutionized representation learning in Remote Sensing (RS), advancing Geospatial Foundation Models (GFMs) to leverage vast unlabeled satellite imagery for diverse downstream tasks. C…

Contrastive LearningImage GenerationRepresentation LearningSelf-Supervised Learning+1

Cold Diffusion: Inverting Arbitrary Image Transforms Without Noise

2022-08-19 · NeurIPS 2023 11 · Arpit Bansal, Eitan Borgnia, Hong-Min Chu, Jie S. Li 외

Standard diffusion models involve an image transform -- adding Gaussian noise -- and an image restoration operator that inverts this degradation. We observe that the generative behavior of diffusion models is not strongl…

Image RestorationVariational Inference