paper-with-me

Papers

Matrix Norm Estimation from a Few Entries

2017-12-01 · NeurIPS 2017 12 · Ashish Khetan, Sewoong Oh

Singular values of a data in a matrix form provide insights on the structure of the data, the effective dimensionality, and the choice of hyper-parameters on higher-level data analysis tools. However, in many practical applications such as collaborative filtering and network analysis, we only get a partial observation. Under such scenarios, we consider the fundamental problem of recovering various spectral properties of the underlying matrix from a sampling of its entries. We propose a framework of first estimating the Schatten $k$-norms of a matrix for several values of $k$, and using these as surrogates for estimating spectral properties of interest, such as the spectrum itself or the rank. This paper focuses on the technical challenges in accurately estimating the Schatten norms from a sampling of a matrix. We introduce a novel unbiased estimator based on counting small structures in a graph and provide guarantees that match its empirical performances. Our theoretical analysis shows that Schatten norms can be recovered accurately from strictly smaller number of samples compared to what is needed to recover the underlying low-rank matrix. Numerical experiments suggest that we significantly improve upon a competing approach of using matrix completion methods.

📄 PDF Abstract BibTeX

Code (1)

khetan2/Schatten_norm_estimation 공식 구현

Tasks

Collaborative FilteringMatrix Completion

Similar Papers 제목 키워드 기반

Rate-Optimal Subspace Estimation on Random Graphs

2021-12-01 · NeurIPS 2021 12 · Zhixin Zhou, Fan Zhou, Ping Li, Cun-Hui Zhang

We study the theory of random bipartite graph whose adjacency matrix is generated according to a connectivity matrix $M$. We consider the bipartite graph to be sparse, i.e., the entries of $M$ are upper bounded by certai…

Sub-Gaussian estimators of the mean of a random matrix with heavy-tailed entries

2016-05-23 · Stanislav Minsker

Estimation of the covariance matrix has attracted a lot of attention of the statistical research community over the years, partially due to important applications such as Principal Component Analysis. However, frequently…

Matrix Completion

Even Faster Kernel Matrix Linear Algebra via Density Estimation

2025-10-02 · Rikhav Shah, Sandeep Silwal, Haike Xu arxiv

This paper studies the use of kernel density estimation (KDE) for linear algebraic tasks involving the kernel matrix of a collection of $n$ data points in $\mathbb R^d$. In particular, we improve upon existing algorithms…

Density Estimation

Optimal Schatten-q and Ky-Fan-k Norm Rate of Low Rank Matrix Estimation

2014-03-25 · Dong Xia

In this paper, we consider low rank matrix estimation using either matrix-version Dantzig Selector $\hat{A}_{\lambda}^d$ or matrix-version LASSO estimator $\hat{A}_{\lambda}^L$. We consider sub-Gaussian measurements, $i.…

Thy Friend is My Friend: Iterative Collaborative Filtering for Sparse Matrix Estimation

2017-12-01 · NeurIPS 2017 12 · Christian Borgs, Jennifer Chayes, Christina E. Lee, Devavrat Shah

The sparse matrix estimation problem consists of estimating the distribution of an $n\times n$ matrix $Y$, from a sparsely observed single instance of this matrix where the entries of $Y$ are independent random variable…

Collaborative FilteringCommunity DetectionGraphon EstimationMatrix Completion+1