paper-with-me

홈 › Papers

Nonparametric Factor Trajectory Learning for Dynamic Tensor Decomposition

2022-07-06 · Zheng Wang, Shandian Zhe

Tensor decomposition is a fundamental framework to analyze data that can be represented by multi-dimensional arrays. In practice, tensor data is often accompanied by temporal information, namely the time points when the entry values were generated. This information implies abundant, complex temporal variation patterns. However, current methods always assume the factor representations of the entities in each tensor mode are static, and never consider their temporal evolution. To fill this gap, we propose NONparametric FActor Trajectory learning for dynamic tensor decomposition (NONFAT). We place Gaussian process (GP) priors in the frequency domain and conduct inverse Fourier transform via Gauss-Laguerre quadrature to sample the trajectory functions. In this way, we can overcome data sparsity and obtain robust trajectory estimates across long time horizons. Given the trajectory values at specific time points, we use a second-level GP to sample the entry values and to capture the temporal relationship between the entities. For efficient and scalable inference, we leverage the matrix Gaussian structure in the model, introduce a matrix Gaussian posterior, and develop a nested sparse variational learning algorithm. We have shown the advantage of our method in several real-world applications.

📄 PDF Abstract BibTeX arXiv:2207.02446

Code (1)

wzhut/nonfat pytorch

Tasks

Tensor Decomposition

Methods 이 논문이 사용한 방법론

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

Tensor-Dictionary Learning with Deep Kruskal-Factor Analysis

2016-12-08 · Andrew Stevens, Yunchen Pu, Yannan Sun, Greg Spell 외

A multi-way factor analysis model is introduced for tensor-variate data of any order. Each data item is represented as a (sparse) sum of Kruskal decompositions, a Kruskal-factor analysis (KFA). KFA is nonparametric and c…

DenoisingDictionary LearningGeneral Classificationimage-classification+1

Streaming Factor Trajectory Learning for Temporal Tensor Decomposition

2023-09-21 · NeurIPS 2023 11

Practical tensor data is often along with time information. Most existing temporal decomposition approaches estimate a set of fixed factors for the objects in each tensor mode, and hence cannot capture the temporal evolu…

Improving Nonparametric Density Estimation with Tensor Decompositions

2020-10-06 · Robert A. Vandermeulen

While nonparametric density estimators often perform well on low dimensional data, their performance can suffer when applied to higher dimensional data, owing presumably to the curse of dimensionality. One technique for …

Density Estimation

Doubly Decomposing Nonparametric Tensor Regression

2015-06-19 · Masaaki Imaizumi, Kohei Hayashi

Nonparametric extension of tensor regression is proposed. Nonlinearity in a high-dimensional tensor space is broken into simple local functions by incorporating low-rank tensor decomposition. Compared to naive nonparamet…

regressionTensor Decomposition

Stochastic Nonparametric Event-Tensor Decomposition

2018-12-01 · NeurIPS 2018 12 · Shandian Zhe, Yishuai Du

Tensor decompositions are fundamental tools for multiway data analysis. Existing approaches, however, ignore the valuable temporal information along with data, or simply discretize them into time steps so that important …

Tensor Decomposition