Group-sparse Embeddings in Collective Matrix Factorization
CMF is a technique for simultaneously learning low-rank representations based on a collection of matrices with shared entities. A typical example is the joint modeling of user-item, item-property, and user-feature matrices in a recommender system. The key idea in CMF is that the embeddings are shared across the matrices, which enables transferring information between them. The existing solutions, however, break down when the individual matrices have low-rank structure not shared with others. In this work we present a novel CMF solution that allows each of the matrices to have a separate low-rank structure that is independent of the other matrices, as well as structures that are shared only by a subset of them. We compare MAP and variational Bayesian solutions based on alternating optimization algorithms and show that the model automatically infers the nature of each factor using group-wise sparsity. Our approach supports in a principled way continuous, binary and count observations and is efficient for sparse matrices involving missing data. We illustrate the solution on a number of examples, focusing in particular on an interesting use-case of augmented multi-view learning.
Code (0)
등록된 구현이 없습니다.
Tasks
MULTI-VIEW LEARNINGRecommendation SystemsSimilar Papers 제목 키워드 기반
Group-Sparse Matrix Factorization for Transfer Learning of Word Embeddings
Unstructured text provides decision-makers with a rich data source in many domains, ranging from product reviews in retail to nursing notes in healthcare. To leverage this information, words are typically translated into…
Generalization BoundsLearning Word EmbeddingsTransfer LearningWord EmbeddingsHyperspectral Image Super-Resolution via Non-Local Sparse Tensor Factorization
Hyperspectral image(HSI)super-resolution, which fuses a low-resolution (LR) HSI with a high-resolution (HR) multispectral image (MSI), has recently attracted much attention. Most of the current HSI super-resolution appro…
Hyperspectral Image Super-ResolutionImage Super-ResolutionSuper-ResolutionNetSMF: Large-Scale Network Embedding as Sparse Matrix Factorization
We study the problem of large-scale network embedding, which aims to learn latent representations for network mining applications. Previous research shows that 1) popular network embedding benchmarks, such as DeepWalk, a…
Network EmbeddingEfficient Mixed Dimension Embeddings for Matrix Factorization
Despite the prominence of neural network approaches in the field of recommender systems, simple methods such as matrix factorization with quadratic loss are still used in industry for several reasons. These models can be…
Recommendation SystemsKnowledge-aware Neural Collective Matrix Factorization for Cross-domain Recommendation
Cross-domain recommendation (CDR) can help customers find more satisfying items in different domains. Existing CDR models mainly use common users or mapping functions as bridges between domains but have very limited expl…
General Knowledge