paper-with-me

홈 › Papers

Nuclear norm penalization and optimal rates for noisy low rank matrix completion

2010-11-29 · Vladimir Koltchinskii, Alexandre B. Tsybakov, Karim Lounici

This paper deals with the trace regression model where $n$ entries or linear combinations of entries of an unknown $m_1\times m_2$ matrix $A_0$ corrupted by noise are observed. We propose a new nuclear norm penalized estimator of $A_0$ and establish a general sharp oracle inequality for this estimator for arbitrary values of $n,m_1,m_2$ under the condition of isometry in expectation. Then this method is applied to the matrix completion problem. In this case, the estimator admits a simple explicit form and we prove that it satisfies oracle inequalities with faster rates of convergence than in the previous works. They are valid, in particular, in the high-dimensional setting $m_1m_2\gg n$. We show that the obtained rates are optimal up to logarithmic factors in a minimax sense and also derive, for any fixed matrix $A_0$, a non-minimax lower bound on the rate of convergence of our estimator, which coincides with the upper bound up to a constant factor. Finally, we show that our procedure provides an exact recovery of the rank of $A_0$ with probability close to 1. We also discuss the statistical learning setting where there is no underlying model determined by $A_0$ and the aim is to find the best trace regression model approximating the data.

📄 PDF Abstract BibTeX arXiv:1011.6256

Code (0)

등록된 구현이 없습니다.

Tasks

Low-Rank Matrix CompletionMatrix Completionregressionvalid

Similar Papers 제목 키워드 기반

Low Rank Matrix Completion with Exponential Family Noise

2015-02-24 · Jean Lafond

The matrix completion problem consists in reconstructing a matrix from a sample of entries, possibly observed with noise. A popular class of estimator, known as nuclear norm penalized estimators, are based on minimizing …

Low-Rank Matrix CompletionMatrix CompletionPrediction

On the Optimality of Nuclear-norm-based Matrix Completion for Problems with Smooth Non-linear Structure

2021-05-05 · Yunhua Xiang, Tianyu Zhang, Xu Wang, Ali Shojaie 외

Originally developed for imputing missing entries in low rank, or approximately low rank matrices, matrix completion has proven widely effective in many problems where there is no reason to assume low-dimensional linear …

Matrix Completion

Nuclear Norm Regularized Estimation of Panel Regression Models

2018-10-25 · Hyungsik Roger Moon, Martin Weidner

In this paper we investigate panel regression models with interactive fixed effects. We propose two new estimation methods that are based on minimizing convex objective functions. The first method minimizes the sum of sq…

regression

Convex recovery of tensors using nuclear norm penalization

2015-06-08 · Stephane Chretien, Tianwen Wei

The subdifferential of convex functions of the singular spectrum of real matrices has been widely studied in matrix analysis, optimization and automatic control theory. Convex analysis and optimization over spaces of ten…

Inference for Low-rank Completion without Sample Splitting with Application to Treatment Effect Estimation

2023-07-31 · Jungjun Choi, Hyukjun Kwon, Yuan Liao

This paper studies the inferential theory for estimating low-rank matrices. It also provides an inference method for the average treatment effect as an application. We show that the least square estimation of eigenvector…