ORBITS: Online Recovery of Missing Blocks in Multiple Time Series Streams
With the emergence of the Internet of Things (IoT), time series streams have become ubiquitous in our daily life. Recording such data is rarely a perfect process, as sensor failures frequently occur, yielding occasional blocks of data that go missing in multiple time series. These missing blocks do not only affect real-time monitoring but also compromise the quality of online data analyses. Effective streaming recovery (imputation) techniques either have a quadratic runtime complexity, which is infeasible for any moderately sized data or cannot recover more than one time series at a time. In this paper, we introduce a new online recovery technique to recover multiple time series streams in linear time. Our recovery technique implements a novel incremental version of the Centroid Decomposition technique and reduces its complexity from quadratic to linear. Using this incremental technique, missing blocks are efficiently recovered in a continuous manner based on previous recoveries. We formally prove the correctness of our new incremental computation, which yields an accurate recovery. Our experimental results on real-world time series show that our recovery technique is, on average, 30% more accurate than the state of the art while being vastly more efficient.
Code (1)
Tasks
ImputationMultivariate Time Series ImputationTime SeriesTime Series AnalysisTime Series StreamsSimilar Papers 제목 키워드 기반
RecovDB: accurate and efficient missing blocks recovery for large time series
With the emergence of the Internet of Things (IoT), time series data has become ubiquitous in our daily life. Making sense of time series is a topic of great interest in many domains. Existing time series analysis applic…
Missing ValuesTime SeriesTime Series AnalysisMind the gap: an experimental evaluation of imputation of missing values techniques in time series
Recording sensor data is seldom a perfect process. Failures in power, communication or storage can leave occasional blocks of data missing, affecting not only real-time monitoring but also compromising the quality of nea…
ImputationMissing ValuesTime SeriesTime Series AnalysisStreaming data preprocessing via online tensor recovery for large environmental sensor networks
Measuring the built and natural environment at a fine-grained scale is now possible with low-cost urban environmental sensor networks. However, fine-grained city-scale data analysis is complicated by tedious data cleanin…
A Spatio-Temporal Online Robust Tensor Recovery Approach for Streaming Traffic Data Imputation
Data quality is critical to Intelligent Transportation Systems (ITS), as complete and accurate traffic data underpin reliable decision-making in traffic control and management. Recent advances in low-rank tensor recovery…
Computational EfficiencyTraffic Data ImputationPolynomial Matrix Completion for Missing Data Imputation and Transductive Learning
This paper develops new methods to recover the missing entries of a high-rank or even full-rank matrix when the intrinsic dimension of the data is low compared to the ambient dimension. Specifically, we assume that the c…
ClusteringImputationMatrix CompletionTransductive Learning