paper-with-me

홈 › Papers

SSIM -A Deep Learning Approach for Recovering Missing Time Series Sensor Data

2019-04-03 · IEEE Internet of Things Journal 2019 4 · Yi-Fan, Zhang ; Peter, Thorburn ; Wei, Xiang ; Peter, Fitch

Missing data are unavoidable in wireless sensor networks, due to issues such as network communication outage, sensor maintenance or failure, etc. Although a plethora of methods have been proposed for imputing sensor data, limitations still exist. Firstly, most methods give poor estimates when a consecutive number of data are missing. Secondly, some methods reconstruct missing data based on other parameters monitored simultaneously. When all the data are missing, these methods are no longer effective. Thirdly, the performance of deep learning methods relies highly on a massive number of training data. Moreover in many scenarios, it is difficult to obtain large volumes of data from wireless sensor networks. Hence, we propose a new sequence-to-sequence imputation model (SSIM) for recovering missing data in wireless sensor networks. The SSIM uses the state-of-the-art sequence-to-sequence deep learning architecture, and the Long Short Term Memory Network is chosen to utilize both the past and future information for a given time. Moreover, a variable-length sliding window algorithm is developed to generate a large number of training samples so the SSIM can be trained with small data sets. We evaluate the SSIM by using real-world time series data from a water quality monitoring network. Compared to methods like ARIMA, Seasonal ARIMA, Matrix Factorization, Multivariate Imputation by Chained Equations and Expectation Maximization, the proposed SSIM achieves up to 69.2%, 70.3%, 98.3% and 76% improvements in terms of the RMSE, MAE, MAPE and SMAPE respectively, when recovering missing data sequences of three different lengths. The SSIM is therefore a promising approach for data quality control in wireless sensor networks.

📄 PDF Abstract BibTeX

Code (1)

ivivan/SSIM_Seq2Seq pytorch

Tasks

ImputationSmall Data Image ClassificationSSIMTime SeriesTime Series Analysis

Methods 이 논문이 사용한 방법론

Memory Network 설명 없음

Similar Papers 제목 키워드 기반

Causality-Aware Spatiotemporal Graph Neural Networks for Spatiotemporal Time Series Imputation

2024-03-18 · Baoyu Jing, Dawei Zhou, Kan Ren, Carl Yang

Spatiotemporal time series are usually collected via monitoring sensors placed at different locations, which usually contain missing values due to various failures, such as mechanical damages and Internet outages. Imputi…

Graph Neural NetworkImputationMissing ValuesTime Series

RecovDB: accurate and efficient missing blocks recovery for large time series

2019-04-08 · 35th IEEE International Conference on Data Engineering (ICDE) 2019 4 · Ines Arous, Mourad Khayati, Philippe Cudré-Mauroux, Ying Zhang 외

With the emergence of the Internet of Things (IoT), time series data has become ubiquitous in our daily life. Making sense of time series is a topic of great interest in many domains. Existing time series analysis applic…

Missing ValuesTime SeriesTime Series Analysis

DynImp: Dynamic Imputation for Wearable Sensing Data Through Sensory and Temporal Relatedness

2022-09-26 · Zepeng Huo, Taowei Ji, Yifei Liang, Shuai Huang 외

In wearable sensing applications, data is inevitable to be irregularly sampled or partially missing, which pose challenges for any downstream application. An unique aspect of wearable data is that it is time-series data …

Activity RecognitionDenoisingImputationTime Series+1

ST-MVL: Filling Missing Values in Geo-Sensory Time Series Data

2016-07-09 · IJCAI 2016 2016 7 · Xiuwen Yi, Yu Zheng, Junbo Zhang, Tianrui Li

Many sensors have been deployed in the physical world, generating massive geo-tagged time series data. In reality, readings of sensors are usually lost at various unexpected moments because of sensor or communication err…

Collaborative FilteringImputationMissing ValuesMultivariate Time Series Imputation+3

Spatiotemporal Tensor Completion for Improved Urban Traffic Imputation

2021-03-12 · Ahmed Ben Said, Abdelkarim Erradi

Effective management of urban traffic is important for any smart city initiative. Therefore, the quality of the sensory traffic data is of paramount importance. However, like any sensory data, urban traffic data are pron…

ImputationManagementMissing ValuesTime Series Analysis