paper-with-me

Papers

Simulation comparisons between Bayesian and de-biased estimators in low-rank matrix completion

2021-03-22 · The Tien Mai

In this paper, we study the low-rank matrix completion problem, a class of machine learning problems, that aims at the prediction of missing entries in a partially observed matrix. Such problems appear in several challenging applications such as collaborative filtering, image processing, and genotype imputation. We compare the Bayesian approaches and a recently introduced de-biased estimator which provides a useful way to build confidence intervals of interest. From a theoretical viewpoint, the de-biased estimator comes with a sharp minimax-optimal rate of estimation error whereas the Bayesian approach reaches this rate with an additional logarithmic factor. Our simulation studies show originally interesting results that the de-biased estimator is just as good as the Bayesian estimators. Moreover, Bayesian approaches are much more stable and can outperform the de-biased estimator in the case of small samples. In addition, we also find that the empirical coverage rate of the confidence intervals obtained by the de-biased estimator for an entry is absolutely lower than of the considered credible interval. These results suggest further theoretical studies on the estimation error and the concentration of Bayesian methods as they are quite limited up to present.

📄 PDF Abstract BibTeX arXiv:2103.11749

Code (1)

tienmt/UQMC 공식 구현

Tasks

Collaborative FilteringImputationLow-Rank Matrix CompletionMatrix Completion

Similar Papers 제목 키워드 기반

Lower Bounds on the Bayes Risk of the Bayesian BTL Model with Applications to Comparison Graphs

2017-09-27 · Mine Alsan, Ranjitha Prasad, Vincent Y. F. Tan

We consider the problem of aggregating pairwise comparisons to obtain a consensus ranking order over a collection of objects. We use the popular Bradley-Terry-Luce (BTL) model which allows us to probabilistically describ…

Non-Bayesian Parametric Missing-Mass Estimation

2021-01-12 · Shir Cohen, Tirza Routtenberg, Lang Tong

We consider the classical problem of missing-mass estimation, which deals with estimating the total probability of unseen elements in a sample. The missing-mass estimation problem has various applications in machine lear…

Sequential Neural Methods for Likelihood-free Inference

2018-11-21 · Conor Durkan, George Papamakarios, Iain Murray

Likelihood-free inference refers to inference when a likelihood function cannot be explicitly evaluated, which is often the case for models based on simulators. Most of the literature is based on sample-based `Approximat…

Inference for Two-Stage Extremum Estimators

2024-02-07 · Aristide Houndetoungan, Abdoul Haki Maoude

We present a simulation-based inference approach for two-stage estimators, focusing on extremum estimators in the second stage. We accommodate a broad range of first-stage estimators, including extremum estimators, high-…

Efficient Debiased Evidence Estimation by Multilevel Monte Carlo Sampling

2020-01-14 · Kei Ishikawa, Takashi Goda

In this paper, we propose a new stochastic optimization algorithm for Bayesian inference based on multilevel Monte Carlo (MLMC) methods. In Bayesian statistics, biased estimators of the model evidence have been often use…

Bayesian InferenceStochastic Optimization