Learning from Binary Multiway Data: Probabilistic Tensor Decomposition and its Statistical Optimality
We consider the problem of decomposing a higher-order tensor with binary entries. Such data problems arise frequently in applications such as neuroimaging, recommendation system, topic modeling, and sensor network localization. We propose a multilinear Bernoulli model, develop a rank-constrained likelihood-based estimation method, and obtain the theoretical accuracy guarantees. In contrast to continuous-valued problems, the binary tensor problem exhibits an interesting phase transition phenomenon according to the signal-to-noise ratio. The error bound for the parameter tensor estimation is established, and we show that the obtained rate is minimax optimal under the considered model. Furthermore, we develop an alternating optimization algorithm with convergence guarantees. The efficacy of our approach is demonstrated through both simulations and analyses of multiple data sets on the tasks of tensor completion and clustering.
Code (1)
Tasks
ClusteringTensor DecompositionSimilar Papers 제목 키워드 기반
Tensor Decompositions: A New Concept in Brain Data Analysis?
Matrix factorizations and their extensions to tensor factorizations and decompositions have become prominent techniques for linear and multilinear blind source separation (BSS), especially multiway Independent Component …
blind source separationClassificationClusteringDimensionality Reduction+2Stochastic Gradients for Large-Scale Tensor Decomposition
Tensor decomposition is a well-known tool for multiway data analysis. This work proposes using stochastic gradients for efficient generalized canonical polyadic (GCP) tensor decomposition of large-scale tensors. GCP tens…
Tensor DecompositionGraph Regularized Nonnegative Tensor Ring Decomposition for Multiway Representation Learning
Tensor ring (TR) decomposition is a powerful tool for exploiting the low-rank nature of multiway data and has demonstrated great potential in a variety of important applications. In this paper, nonnegative tensor ring (N…
ClusteringRepresentation LearningProbabilistic Streaming Tensor Decomposition with Side Information
Tensor decomposition is an essential tool to analyze high-order interactions in multiway data. While most tensor decomposition approaches are developed for static data, many real-world applications generate tensor elemen…
Tensor DecompositionProbabilistic Streaming Tensor Decomposition
Tensor decomposition is a fundamental tool for multiway data analysis. While most decomposition algorithms operate a collection of static data and perform batch processes, many applications produce data in a streaming ma…
Bayesian InferenceTensor Decomposition