Heterogeneous Tensor Decomposition for Clustering via Manifold Optimization
Tensors or multiarray data are generalizations of matrices. Tensor clustering has become a very important research topic due to the intrinsically rich structures in real-world multiarray datasets. Subspace clustering based on vectorizing multiarray data has been extensively researched. However, vectorization of tensorial data does not exploit complete structure information. In this paper, we propose a subspace clustering algorithm without adopting any vectorization process. Our approach is based on a novel heterogeneous Tucker decomposition model. In contrast to existing techniques, we propose a new clustering algorithm that alternates between different modes of the proposed heterogeneous tensor model. All but the last mode have closed-form updates. Updating the last mode reduces to optimizing over the so-called multinomial manifold, for which we investigate second order Riemannian geometry and propose a trust-region algorithm. Numerical experiments show that our proposed algorithm compete effectively with state-of-the-art clustering algorithms that are based on tensor factorization.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringTensor DecompositionSimilar Papers 제목 키워드 기반
Mitigating Heterogeneity among Factor Tensors via Lie Group Manifolds for Tensor Decomposition Based Temporal Knowledge Graph Embedding
Recent studies have highlighted the effectiveness of tensor decomposition methods in the Temporal Knowledge Graphs Embedding (TKGE) task. However, we found that inherent heterogeneity among factor tensors in tensor decom…
Graph EmbeddingKnowledge Graph EmbeddingKnowledge GraphsLink Prediction+2Experimental Analysis of Legendre Decomposition in Machine Learning
In this technical report, we analyze Legendre decomposition for non-negative tensor in theory and application. In theory, the properties of dual parameters and dually flat manifold in Legendre decomposition are reviewed,…
BIG-bench Machine LearningClusteringHyperNTF: A Hypergraph Regularized Nonnegative Tensor Factorization for Dimensionality Reduction
Tensor decomposition is an effective tool for learning multi-way structures and heterogeneous features from high-dimensional data, such as the multi-view images and multichannel electroencephalography (EEG) signals, are …
ClusteringDimensionality ReductionEEGElectroencephalogram (EEG)+2Graph Regularized Nonnegative Tensor Ring Decomposition for Multiway Representation Learning
Tensor ring (TR) decomposition is a powerful tool for exploiting the low-rank nature of multiway data and has demonstrated great potential in a variety of important applications. In this paper, nonnegative tensor ring (N…
ClusteringRepresentation LearningFast Hypergraph Regularized Nonnegative Tensor Ring Factorization Based on Low-Rank Approximation
For the high dimensional data representation, nonnegative tensor ring (NTR) decomposition equipped with manifold learning has become a promising model to exploit the multi-dimensional structure and extract the feature fr…