paper-with-me

홈 › Papers

One-pass additive-error subset selection for $\ell_{p}$ subspace approximation

2022-04-26 · Amit Deshpande, Rameshwar Pratap

We consider the problem of subset selection for $\ell_{p}$ subspace approximation, that is, to efficiently find a \emph{small} subset of data points such that solving the problem optimally for this subset gives a good approximation to solving the problem optimally for the original input. Previously known subset selection algorithms based on volume sampling and adaptive sampling \cite{DeshpandeV07}, for the general case of $p \in [1, \infty)$, require multiple passes over the data. In this paper, we give a one-pass subset selection with an additive approximation guarantee for $\ell_{p}$ subspace approximation, for any $p \in [1, \infty)$. Earlier subset selection algorithms that give a one-pass multiplicative $(1+\epsilon)$ approximation work under the special cases. Cohen \textit{et al.} \cite{CohenMM17} gives a one-pass subset section that offers multiplicative $(1+\epsilon)$ approximation guarantee for the special case of $\ell_{2}$ subspace approximation. Mahabadi \textit{et al.} \cite{MahabadiRWZ20} gives a one-pass \emph{noisy} subset selection with $(1+\epsilon)$ approximation guarantee for $\ell_{p}$ subspace approximation when $p \in \{1, 2\}$. Our subset selection algorithm gives a weaker, additive approximation guarantee, but it works for any $p \in [1, \infty)$.

📄 PDF Abstract BibTeX arXiv:2204.12073

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

On Subspace Approximation and Subset Selection in Fewer Passes by MCMC Sampling

2021-03-20 · Amit Deshpande, Rameshwar Pratap

We consider the problem of subset selection for $\ell_{p}$ subspace approximation, i.e., given $n$ points in $d$ dimensions, we need to pick a small, representative subset of the given points such that its span gives $(1…

Gradient Boosting within a Single Attention Layer

2026-04-03 · Saleh Sargolzaei arxiv

Transformer attention computes a single softmax-weighted average over values -- a one-pass estimate that cannot correct its own errors. We introduce \emph{gradient-boosted attention}, which applies the principle of gradi…

Guessing Efficiently for Constrained Subspace Approximation

2025-04-29 · Aditya Bhaskara, Sepideh Mahabadi, Madhusudhan Reddy Pittu, Ali Vakilian 외

In this paper we study constrained subspace approximation problem. Given a set of $n$ points $\{a_1,\ldots,a_n\}$ in $\mathbb{R}^d$, the goal of the {\em subspace approximation} problem is to find a $k$ dimensional subsp…

Clustering

A Classifier-free Ensemble Selection Method based on Data Diversity in Random Subspaces

2014-08-13 · Albert H. R. Ko, Robert Sabourin, Alceu S. Britto Jr, Luiz E. S. Oliveira

The Ensemble of Classifiers (EoC) has been shown to be effective in improving the performance of single classifiers by combining their outputs, and one of the most important properties involved in the selection of the be…

ClusteringDiversity

SAGE: Streaming Agreement-Driven Gradient Sketches for Representative Subset Selection

2025-10-02 · Ashish Jha, Salman Ahmadi-Asl arxiv

Training modern neural networks on large datasets is computationally and energy intensive. We present SAGE, a streaming data-subset selection method that maintains a compact Frequent Directions (FD) sketch of gradient ge…

Model Compression