paper-with-me

Papers

Fast $(1+\varepsilon)$-Approximation Algorithms for Binary Matrix Factorization

2023-06-02 · Ameya Velingker, Maximilian Vötsch, David P. Woodruff, Samson Zhou

We introduce efficient $(1+\varepsilon)$-approximation algorithms for the binary matrix factorization (BMF) problem, where the inputs are a matrix $\mathbf{A}\in\{0,1\}^{n\times d}$, a rank parameter $k>0$, as well as an accuracy parameter $\varepsilon>0$, and the goal is to approximate $\mathbf{A}$ as a product of low-rank factors $\mathbf{U}\in\{0,1\}^{n\times k}$ and $\mathbf{V}\in\{0,1\}^{k\times d}$. Equivalently, we want to find $\mathbf{U}$ and $\mathbf{V}$ that minimize the Frobenius loss $\|\mathbf{U}\mathbf{V} - \mathbf{A}\|_F^2$. Before this work, the state-of-the-art for this problem was the approximation algorithm of Kumar et. al. [ICML 2019], which achieves a $C$-approximation for some constant $C\ge 576$. We give the first $(1+\varepsilon)$-approximation algorithm using running time singly exponential in $k$, where $k$ is typically a small integer. Our techniques generalize to other common variants of the BMF problem, admitting bicriteria $(1+\varepsilon)$-approximation algorithms for $L_p$ loss functions and the setting where matrix operations are performed in $\mathbb{F}_2$. Our approach can be implemented in standard big data models, such as the streaming or distributed models.

📄 PDF Abstract BibTeX arXiv:2306.01869

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Optimal $\ell_1$ Column Subset Selection and a Fast PTAS for Low Rank Approximation

2020-07-20 · Arvind V. Mahankali, David P. Woodruff

We study the problem of entrywise $\ell_1$ low rank approximation. We give the first polynomial time column subset selection-based $\ell_1$ low rank approximation algorithm sampling $\tilde{O}(k)$ columns and achieving a…

A Combinatorial Algorithm for Approximating the Optimal Transport in the Parallel and MPC Settings

2023-09-21 · NeurIPS 2023 11

Optimal Transport is a popular distance metric for measuring similarity between distributions. Exact and approximate combinatorial algorithms for computing the optimal transport distance are hard to parallelize. This has…

Krylov Methods are (nearly) Optimal for Low-Rank Approximation

2023-04-06 · Ainesh Bakshi, Shyam Narayanan

We consider the problem of rank-$1$ low-rank approximation (LRA) in the matrix-vector product model under various Schatten norms: $$ \min_{\|u\|_2=1} \|A (I - u u^\top)\|_{\mathcal{S}_p} , $$ where $\|M\|_{\mathcal{S}_p}…

Open-Ended Question Answering

Fast approximation and learning of binary classification tasks in o-minimal structures using ReLU neural networks

2026-06-29 · Clemens Kinn, Philipp Petersen arxiv

We study binary classification problems whose decision sets are given by definable sets in o-minimal expansions of the real field. Motivated by cell decomposition of definable sets, we introduce traceable sets as a class…

Binary Classification

Subsampling in Smoothed Range Spaces

2015-10-30 · Jeff M. Phillips, Yan Zheng

We consider smoothed versions of geometric range spaces, so an element of the ground set (e.g. a point) can be contained in a range with a non-binary value in $[0,1]$. Similar notions have been considered for kernels; we…