paper-with-me

Papers

DiffImp: Efficient Diffusion Model for Probabilistic Time Series Imputation with Bidirectional Mamba Backbone

2024-10-17 · Hongfan Gao, Wangmeng Shen, Xiangfei Qiu, Ronghui Xu, Jilin Hu, Bin Yang

Probabilistic time series imputation has been widely applied in real-world scenarios due to its ability to estimate uncertainty of imputation results. Meanwhile, denoising diffusion probabilistic models (DDPMs) have achieved great success in probabilistic time series imputation tasks with its power to model complex distributions. However, current DDPM-based probabilistic time series imputation methodologies are confronted with two types of challenges: 1)~\textit{~The backbone modules of the denoising parts are not capable of achieving sequence modeling with low time complexity.} 2)~\textit{The architecture of denoising modules can not handle the inter-variable and bidirectional dependencies in the time series imputation problem effectively.} To address the first challenge, we integrate the computational efficient state space model, namely Mamba, as the backbone denosing module for DDPMs. To tackle the second challenge, we carefully devise several SSM-based blocks for bidirectional modeling and inter-variable relation understanding. Experimental results demonstrate that our approach can achieve state-of-the-art time series imputation results on multiple datasets, different missing scenarios and missing ratios.

📄 PDF Abstract BibTeX arXiv:2410.13338

Code (0)

등록된 구현이 없습니다.

Tasks

DenoisingImputationMambaTime Series

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
Mamba Foundation models, now powering most of the exciting applications in deep learning, are almost universally based on the Transformer architecture and its core attention module.…

Similar Papers 제목 키워드 기반

DiffImpute: Tabular Data Imputation With Denoising Diffusion Probabilistic Model

2024-03-20 · Yizhu Wen, Kai Yi, Jing Ke, Yiqing Shen

Tabular data plays a crucial role in various domains but often suffers from missing values, thereby curtailing its potential utility. Traditional imputation techniques frequently yield suboptimal results and impose subst…

DenoisingImputationMissing Values

CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputation

2021-07-07 · NeurIPS 2021 12 · Yusuke Tashiro, Jiaming Song, Yang song, Stefano Ermon

The imputation of missing values in time series has many applications in healthcare and finance. While autoregressive models are natural candidates for time series imputation, score-based diffusion models have recently o…

Audio SynthesisImage GenerationImputationMissing Values+2

Latent Space Score-based Diffusion Model for Probabilistic Multivariate Time Series Imputation

2024-09-13 · Guojun Liang, Najmeh Abiri, Atiye Sadat Hashemi, Jens Lundström 외

Accurate imputation is essential for the reliability and success of downstream tasks. Recently, diffusion models have attracted great attention in this field. However, these models neglect the latent distribution in a lo…

ImputationMultivariate Time Series ImputationTime Series

Diffusion-based Time Series Imputation and Forecasting with Structured State Space Models

2022-08-19 · Juan Miguel Lopez Alcaraz, Nils Strodthoff

The imputation of missing values represents a significant obstacle for many real-world data analysis pipelines. Here, we focus on time series data and put forward SSSD, an imputation model that relies on two emerging tec…

ImputationMissing ValuesState Space ModelsTime Series+1

Recurrent Interpolants for Probabilistic Time Series Prediction

2024-09-18 · Yu Chen, Marin Biloš, Sarthak Mittal, Wei Deng 외

Sequential models like recurrent neural networks and transformers have become standard for probabilistic multivariate time series forecasting across various domains. Despite their strengths, they struggle with capturing …

Computational EfficiencyImputationMultivariate Time Series ForecastingPrediction+3