SSIM -A Deep Learning Approach for Recovering Missing Time Series Sensor Data
Missing data are unavoidable in wireless sensor networks, due to issues such as network communication outage, sensor maintenance or failure, etc. Although a plethora of methods have been proposed for imputing sensor data, limitations still exist. Firstly, most methods give poor estimates when a consecutive number of data are missing. Secondly, some methods reconstruct missing data based on other parameters monitored simultaneously. When all the data are missing, these methods are no longer effective. Thirdly, the performance of deep learning methods relies highly on a massive number of training data. Moreover in many scenarios, it is difficult to obtain large volumes of data from wireless sensor networks. Hence, we propose a new sequence-to-sequence imputation model (SSIM) for recovering missing data in wireless sensor networks. The SSIM uses the state-of-the-art sequence-to-sequence deep learning architecture, and the Long Short Term Memory Network is chosen to utilize both the past and future information for a given time. Moreover, a variable-length sliding window algorithm is developed to generate a large number of training samples so the SSIM can be trained with small data sets. We evaluate the SSIM by using real-world time series data from a water quality monitoring network. Compared to methods like ARIMA, Seasonal ARIMA, Matrix Factorization, Multivariate Imputation by Chained Equations and Expectation Maximization, the proposed SSIM achieves up to 69.2%, 70.3%, 98.3% and 76% improvements in terms of the RMSE, MAE, MAPE and SMAPE respectively, when recovering missing data sequences of three different lengths. The SSIM is therefore a promising approach for data quality control in wireless sensor networks.
Code (1)
Tasks
ImputationSmall Data Image ClassificationSSIMTime SeriesTime Series AnalysisMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Causality-Aware Spatiotemporal Graph Neural Networks for Spatiotemporal Time Series Imputation
Spatiotemporal time series are usually collected via monitoring sensors placed at different locations, which usually contain missing values due to various failures, such as mechanical damages and Internet outages. Imputi…
Graph Neural NetworkImputationMissing ValuesTime SeriesRecovDB: accurate and efficient missing blocks recovery for large time series
With the emergence of the Internet of Things (IoT), time series data has become ubiquitous in our daily life. Making sense of time series is a topic of great interest in many domains. Existing time series analysis applic…
Missing ValuesTime SeriesTime Series AnalysisDynImp: Dynamic Imputation for Wearable Sensing Data Through Sensory and Temporal Relatedness
In wearable sensing applications, data is inevitable to be irregularly sampled or partially missing, which pose challenges for any downstream application. An unique aspect of wearable data is that it is time-series data …
Activity RecognitionDenoisingImputationTime Series+1ST-MVL: Filling Missing Values in Geo-Sensory Time Series Data
Many sensors have been deployed in the physical world, generating massive geo-tagged time series data. In reality, readings of sensors are usually lost at various unexpected moments because of sensor or communication err…
Collaborative FilteringImputationMissing ValuesMultivariate Time Series Imputation+3Spatiotemporal Tensor Completion for Improved Urban Traffic Imputation
Effective management of urban traffic is important for any smart city initiative. Therefore, the quality of the sensory traffic data is of paramount importance. However, like any sensory data, urban traffic data are pron…
ImputationManagementMissing ValuesTime Series Analysis