Multistage Large Segment Imputation Framework Based on Deep Learning and Statistic Metrics

2022-09-22 · JinSheng Yang, YuanHai Shao, ChunNa Li, Wensi Wang

Missing value is a very common and unavoidable problem in sensors, and researchers have made numerous attempts for missing value imputation, particularly in deep learning models. However, for real sensor data, the specific data distribution and data periods are rarely considered, making it difficult to choose the appropriate evaluation indexes and models for different sensors. To address this issue, this study proposes a multistage imputation framework based on deep learning with adaptability for missing value imputation. The model presents a mixture measurement index of low- and higher-order statistics for data distribution and a new perspective on data imputation performance metrics, which is more adaptive and effective than the traditional mean squared error. A multistage imputation strategy and dynamic data length are introduced into the imputation process for data periods. Experimental results on different types of sensor data show that the multistage imputation strategy and the mixture index are superior and that the effect of missing value imputation has been improved to some extent, particularly for the large segment imputation problem. The codes and experimental results have been uploaded to GitHub.

📄 PDF Abstract BibTeX arXiv:2209.11766

Code (1)

bombooooo/mlsif 공식 구현 pytorch

Tasks

Imputation

Data Imputation for Multivariate Time Series Sensor Data with Large Gaps of Missing Data

2022-06-01 · IEEE Sensors Journal 2022 6 · Rui Wu, Scott D. Hamshaw, Lei Yang, Dustin W. Kincaid 외

Imputation of missing sensor-collected data is often an important step prior to machine learning and statistical data analysis. One particular data imputation challenge is filling large data gaps when the only related da…

Imputation Time Series Time Series Analysis

CINDI: Conditional Imputation and Noisy Data Integrity with Flows in Power Grid Data

2026-03-12 · David Baumgartner, Helge Langseth, Heri Ramampiaro arxiv

Real-world multivariate time series, particularly in critical infrastructure such as electrical power grids, are often corrupted by noise and anomalies that degrade the performance of downstream tasks. Standard data clea…

Anomaly Detection

Longitudinal diffusion MRI analysis using Segis-Net: a single-step deep-learning framework for simultaneous segmentation and registration

2020-12-28 · Bo Li, Wiro J. Niessen, Stefan Klein, Marius de Groot 외

This work presents a single-step deep-learning framework for longitudinal image analysis, coined Segis-Net. To optimally exploit information available in longitudinal data, this method concurrently learns a multi-class s…

Diffusion MRI Segmentation

Multiple data-driven missing imputation

2025-07-03 · Sergii Kavun arxiv

This paper introduces KZImputer, a novel adaptive imputation method for univariate time series designed for short to medium-sized missed points (gaps) (1-5 points and beyond) with tailored strategies for segments at the …

Time Series Analysis

Multiple Imputation via Generative Adversarial Network for High-dimensional Blockwise Missing Value Problems

2021-12-21 · Zongyu Dai, Zhiqi Bu, Qi Long

Missing data are present in most real world problems and need careful handling to preserve the prediction accuracy and statistical consistency in the downstream analysis. As the gold standard of handling missing data, mu…

Generative Adversarial Network Imputation