paper-with-me

홈 › Papers

$k$-PCA for (non-squared) Euclidean Distances: Polynomial Time Approximation

2025-07-19 · Daniel Greenhut, Dan Feldman arxiv

Given an integer $k\geq1$ and a set $P$ of $n$ points in $\REAL^d$, the classic $k$-PCA (Principle Component Analysis) approximates the affine \emph{$k$-subspace mean} of $P$, which is the $k$-dimensional affine linear subspace that minimizes its sum of squared Euclidean distances ($\ell_{2,2}$-norm) over the points of $P$, i.e., the mean of these distances. The \emph{$k$-subspace median} is the subspace that minimizes its sum of (non-squared) Euclidean distances ($\ell_{2,1}$-mixed norm), i.e., their median. The median subspace is usually more sparse and robust to noise/outliers than the mean, but also much harder to approximate since, unlike the $\ell_{z,z}$ (non-mixed) norms, it is non-convex for $k<d-1$. We provide the first polynomial-time deterministic algorithm whose both running time and approximation factor are not exponential in $k$. More precisely, the multiplicative approximation factor is $\sqrt{d}$, and the running time is polynomial in the size of the input. We expect that our technique would be useful for many other related problems, such as $\ell_{2,z}$ norm of distances for $z\not \in \br{1,2}$, e.g., $z=\infty$, and handling outliers/sparsity. Open code and experimental results on real-world datasets are also provided.

📄 PDF Abstract BibTeX arXiv:2507.14631

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Kinetic Euclidean Distance Matrices

2019-03-15

Euclidean distance matrices (EDMs) are a major tool for localization from distances, with applications ranging from protein structure determination to global positioning and manifold learning. They are, however, static o…

Tackling Early Sparse Gradients in Softmax Activation Using Leaky Squared Euclidean Distance

2018-11-27 · Wei Shen, Rujie Liu

Softmax activation is commonly used to output the probability distribution over categories based on certain distance metric. In scenarios like one-shot learning, the distance metric is often chosen to be squared Euclidea…

One-Shot Learning

An $\tilde{O}(n^{5/4})$ Time $\varepsilon$-Approximation Algorithm for RMS Matching in a Plane

2020-07-15 · Nathaniel Lahn, Sharath Raghvendra

The 2-Wasserstein distance (or RMS distance) is a useful measure of similarity between probability distributions that has exciting applications in machine learning. For discrete distributions, the problem of computing th…

Rehabilitating Isomap: Euclidean Representation of Geodesic Structure

2020-06-18 · Michael W. Trosset, Gokcen Buyukbas

Manifold learning techniques for nonlinear dimension reduction assume that high-dimensional feature vectors lie on a low-dimensional manifold, then attempt to exploit manifold structure to obtain useful low-dimensional E…

Dimensionality Reduction

Subspace approximation with outliers

2020-06-30 · Amit Deshpande, Rameshwar Pratap

The subspace approximation problem with outliers, for given $n$ points in $d$ dimensions $x_{1},\ldots, x_{n} \in R^{d}$, an integer $1 \leq k \leq d$, and an outlier parameter $0 \leq \alpha \leq 1$, is to find a $k$-di…

Dimensionality Reduction