paper-with-me

홈 › Papers

MFAI: A Scalable Bayesian Matrix Factorization Approach to Leveraging Auxiliary Information

2023-03-05 · Zhiwei Wang, Fa Zhang, Cong Zheng, Xianghong Hu, Mingxuan Cai, Can Yang

In various practical situations, matrix factorization methods suffer from poor data quality, such as high data sparsity and low signal-to-noise ratio (SNR). Here, we consider a matrix factorization problem by utilizing auxiliary information, which is massively available in real-world applications, to overcome the challenges caused by poor data quality. Unlike existing methods that mainly rely on simple linear models to combine auxiliary information with the main data matrix, we propose to integrate gradient boosted trees in the probabilistic matrix factorization framework to effectively leverage auxiliary information (MFAI). Thus, MFAI naturally inherits several salient features of gradient boosted trees, such as the capability of flexibly modeling nonlinear relationships and robustness to irrelevant features and missing values in auxiliary information. The parameters in MFAI can be automatically determined under the empirical Bayes framework, making it adaptive to the utilization of auxiliary information and immune to overfitting. Moreover, MFAI is computationally efficient and scalable to large datasets by exploiting variational inference. We demonstrate the advantages of MFAI through comprehensive numerical results from simulation studies and real data analyses. Our approach is implemented in the R package mfair available at https://github.com/YangLabHKUST/mfair.

📄 PDF Abstract BibTeX arXiv:2303.02566

Code (1)

YangLabHKUST/mfair 공식 구현

Tasks

Missing ValuesVariational Inference

Similar Papers 제목 키워드 기반

Scalable Recommendation with Poisson Factorization

2013-11-07 · Prem Gopalan, Jake M. Hofman, David M. Blei

We develop a Bayesian Poisson matrix factorization model for forming recommendations from sparse user behavior data. These data are large user/item matrices where each user has provided feedback on only a small subset of…

Variational Inference

Large-Scale Distributed Bayesian Matrix Factorization using Stochastic Gradient MCMC

2015-03-05 · Sungjin Ahn, Anoop Korattikara, Nathan Liu, Suju Rajan 외

Despite having various attractive qualities such as high prediction accuracy and the ability to quantify uncertainty and avoid over-fitting, Bayesian Matrix Factorization has not been widely adopted because of the prohib…

Prediction

Unitary Approximate Message Passing for Matrix Factorization

2022-07-31 · Zhengdao Yuan, Qinghua Guo, Yonina C. Eldar, Yonghui Li

We consider matrix factorization (MF) with certain constraints, which finds wide applications in various areas. Leveraging variational inference (VI) and unitary approximate message passing (UAMP), we develop a Bayesian …

Compressive SensingDictionary LearningVariational Inference

A High-Performance Implementation of Bayesian Matrix Factorization with Limited Communication

2020-04-06 · Tom Vander Aa, Xiangju Qin, Paul Blomstedt, Roel Wuyts 외

Matrix factorization is a very common machine learning technique in recommender systems. Bayesian Matrix Factorization (BMF) algorithms would be attractive because of their ability to quantify uncertainty in their predic…

Recommendation SystemsVocal Bursts Intensity Prediction

Scalable Bayesian Non-linear Matrix Completion

2019-07-31 · Xiangju Qin, Paul Blomstedt, Samuel Kaski

Matrix completion aims to predict missing elements in a partially observed data matrix which in typical applications, such as collaborative filtering, is large and extremely sparsely observed. A standard solution is matr…

Collaborative FilteringMatrix CompletionMissing Elements