Diffusion-based Time Series Data Imputation for Microsoft 365
Reliability is extremely important for large-scale cloud systems like Microsoft 365. Cloud failures such as disk failure, node failure, etc. threaten service reliability, resulting in online service interruptions and economic loss. Existing works focus on predicting cloud failures and proactively taking action before failures happen. However, they suffer from poor data quality like data missing in model training and prediction, which limits the performance. In this paper, we focus on enhancing data quality through data imputation by the proposed Diffusion+, a sample-efficient diffusion model, to impute the missing data efficiently based on the observed data. Our experiments and application practice show that our model contributes to improving the performance of the downstream failure prediction task.
Code (0)
등록된 구현이 없습니다.
Tasks
ImputationTime SeriesMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
ImDiffusion: Imputed Diffusion Models for Multivariate Time Series Anomaly Detection
Anomaly detection in multivariate time series data is of paramount importance for ensuring the efficient operation of large-scale systems across diverse domains. However, accurately detecting anomalies in such data poses…
Anomaly DetectionImputationTime SeriesTime Series Anomaly DetectionCSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputation
The imputation of missing values in time series has many applications in healthcare and finance. While autoregressive models are natural candidates for time series imputation, score-based diffusion models have recently o…
Audio SynthesisImage GenerationImputationMissing Values+2sasdim: self-adaptive noise scaling diffusion model for spatial time series imputation
Spatial time series imputation is critically important to many real applications such as intelligent transportation and air quality monitoring. Although recent transformer and diffusion model based approaches have achiev…
ImputationTime SeriesDiscretizing Continuous Time Series for Imputation with Masked Diffusion Training
Time series imputation is a crucial area for reliable time series analysis, yet it remains challenging due to the complex temporal dynamics and noise of real-world data. Existing approaches, however, exhibit two limitati…
Time Series AnalysisDiffImp: Efficient Diffusion Model for Probabilistic Time Series Imputation with Bidirectional Mamba Backbone
Probabilistic time series imputation has been widely applied in real-world scenarios due to its ability to estimate uncertainty of imputation results. Meanwhile, denoising diffusion probabilistic models (DDPMs) have achi…
DenoisingImputationMambaTime Series