Temporal Regularized Matrix Factorization for High-dimensional Time Series Prediction
Time series prediction problems are becoming increasingly high-dimensional in modern applications, such as climatology and demand forecasting. For example, in the latter problem, the number of items for which demand needs to be forecast might be as large as 50,000. In addition, the data is generally noisy and full of missing values. Thus, modern applications require methods that are highly scalable, and can deal with noisy data in terms of corruptions or missing values. However, classical time series methods usually fall short of handling these issues. In this paper, we present a temporal regularized matrix factorization (TRMF) framework which supports data-driven temporal learning and forecasting. We develop novel regularization schemes and use scalable matrix factorization methods that are eminently suited for high-dimensional time series data that has many missing values. Our proposed TRMF is highly general, and subsumes many existing approaches for time series analysis. We make interesting connections to graph regularization methods in the context of learning the dependencies in an autoregressive framework. Experimental results show the superiority of TRMF in terms of scalability and prediction quality. In particular, TRMF is two orders of magnitude faster than other methods on a problem of dimension 50,000, and generates better forecasts on real-world datasets such as Wal-mart E-commerce datasets.
Code (1)
Tasks
Demand ForecastingMissing ValuesTime SeriesTime Series AnalysisTime Series PredictionVocal Bursts Intensity PredictionSimilar Papers 제목 키워드 기반
High-dimensional Time Series Prediction with Missing Values
High-dimensional time series prediction is needed in applications as diverse as demand forecasting and climatology. Often, such applications require methods that are both highly scalable, and deal with noisy data in term…
Demand ForecastingMatrix CompletionMissing ValuesPrediction+4Graph Regularized Nonnegative Matrix Factorization for Data Representation
Matrix factorization techniques have been frequently applied in information retrieval, computer vision, and pattern recognition. Among them, Nonnegative Matrix Factorization (NMF) has received considerable attention due…
Information RetrievalRetrievalHyperNTF: A Hypergraph Regularized Nonnegative Tensor Factorization for Dimensionality Reduction
Tensor decomposition is an effective tool for learning multi-way structures and heterogeneous features from high-dimensional data, such as the multi-view images and multichannel electroencephalography (EEG) signals, are …
ClusteringDimensionality ReductionEEGElectroencephalogram (EEG)+2On the Loss Landscape Geometry of Regularized Deep Matrix Factorization: Uniqueness and Sharpness
Weight decay is ubiquitous in training deep neural network architectures. Its empirical success is often attributed to capacity control; nonetheless, our theoretical understanding of its effect on the loss landscape and …
Graph Regularized NMF with L20-norm for Unsupervised Feature Learning
Nonnegative Matrix Factorization (NMF) is a widely applied technique in the fields of machine learning and data mining. Graph Regularized Non-negative Matrix Factorization (GNMF) is an extension of NMF that incorporates …
Dimensionality Reductionfeature selection