paper-with-me

홈 › Papers

Robust Factorization of Real-world Tensor Streams with Patterns, Missing Values, and Outliers

2021-02-16 · Dongjin Lee, Kijung Shin

Consider multiple seasonal time series being collected in real-time, in the form of a tensor stream. Real-world tensor streams often include missing entries (e.g., due to network disconnection) and at the same time unexpected outliers (e.g., due to system errors). Given such a real-world tensor stream, how can we estimate missing entries and predict future evolution accurately in real-time? In this work, we answer this question by introducing SOFIA, a robust factorization method for real-world tensor streams. In a nutshell, SOFIA smoothly and tightly integrates tensor factorization, outlier removal, and temporal-pattern detection, which naturally reinforce each other. Moreover, SOFIA integrates them in linear time, in an online manner, despite the presence of missing entries. We experimentally show that SOFIA is (a) robust and accurate: yielding up to 76% lower imputation error and 71% lower forecasting error; (b) fast: up to 935X faster than the second-most accurate competitor; and (c) scalable: scaling linearly with the number of new entries per time step.

📄 PDF Abstract BibTeX arXiv:2102.08466

Code (1)

wooner49/sofia 공식 구현

Tasks

ImputationMissing ValuesTime SeriesTime Series Analysis

Similar Papers 제목 키워드 기반

Spatio-Temporal Tensor Sketching via Adaptive Sampling

2020-06-21 · Jing Ma, Qiuchen Zhang, Joyce C. Ho, Li Xiong

Mining massive spatio-temporal data can help a variety of real-world applications such as city capacity planning, event management, and social network analysis. The tensor representation can be used to capture the correl…

Management

GOCPT: Generalized Online Canonical Polyadic Tensor Factorization and Completion

2022-05-08 · Chaoqi Yang, Cheng Qian, Jimeng Sun

Low-rank tensor factorization or completion is well-studied and applied in various online settings, such as online tensor factorization (where the temporal mode grows) and online tensor completion (where incomplete slice…

Multi-Head Self-Attending Neural Tucker Factorization

2025-01-16 · Yikai Hou, Peng Tang

Quality-of-service (QoS) data exhibit dynamic temporal patterns that are crucial for accurately predicting missing values. These patterns arise from the evolving interactions between users and services, making it essenti…

Missing Values

Online nonnegative CP-dictionary learning for Markovian data

2020-09-16 · Hanbaek Lyu, Christopher Strohmeier, Deanna Needell

Online Tensor Factorization (OTF) is a fundamental tool in learning low-dimensional interpretable features from streaming multi-modal data. While various algorithmic and theoretical aspects of OTF have been investigated …

Dictionary LearningOnline nonnegative CP decompositionTime Series Analysis

Time-Aware Tensor Decomposition for Missing Entry Prediction

2020-12-16 · Dawon Ahn, Jun-Gi Jang, U Kang

Given a time-evolving tensor with missing entries, how can we effectively factorize it for precisely predicting the missing entries? Tensor factorization has been extensively utilized for analyzing various multi-dimensio…

PredictionTensor Decomposition