paper-with-me

홈 › Papers

Revisiting the Approximate Carathéodory Problem via the Frank-Wolfe Algorithm

2019-11-11 · Cyrille W. Combettes, Sebastian Pokutta

The approximate Carath\'eodory theorem states that given a compact convex set $\mathcal{C}\subset\mathbb{R}^n$ and $p\in\left[2,+\infty\right[$, each point $x^*\in\mathcal{C}$ can be approximated to $\epsilon$-accuracy in the $\ell_p$-norm as the convex combination of $\mathcal{O}(pD_p^2/\epsilon^2)$ vertices of $\mathcal{C}$, where $D_p$ is the diameter of $\mathcal{C}$ in the $\ell_p$-norm. A solution satisfying these properties can be built using probabilistic arguments or by applying mirror descent to the dual problem. We revisit the approximate Carath\'eodory problem by solving the primal problem via the Frank-Wolfe algorithm, providing a simplified analysis and leading to an efficient practical method. Furthermore, improved cardinality bounds are derived naturally using existing convergence rates of the Frank-Wolfe algorithm in different scenarios, when $x^*$ is in the interior of $\mathcal{C}$, when $x^*$ is the convex combination of a subset of vertices with small diameter, or when $\mathcal{C}$ is uniformly convex. We also propose cardinality bounds when $p\in\left[1,2\right[\cup\{+\infty\}$ via a nonsmooth variant of the algorithm. Lastly, we address the problem of finding sparse approximate projections onto $\mathcal{C}$ in the $\ell_p$-norm, $p\in\left[1,+\infty\right]$.

📄 PDF Abstract BibTeX arXiv:1911.04415

Code (1)

cyrillewcombettes/approxcara 공식 구현

Similar Papers 제목 키워드 기반

Tight Bounds for Approximate Carathéodory and Beyond

2015-12-29 · ICML 2017 8 · Vahab Mirrokni, Renato Paes Leme, Adrian Vladu, Sam Chiu-wai Wong

We give a deterministic nearly-linear time algorithm for approximating any point inside a convex polytope with a sparse convex combination of the polytope's vertices. Our result provides a constructive proof for the Appr…

The Optimization Landscape of Carathéodory Decomposition of Toeplitz Covariances

2025-11-03 · Daniel Busbib, Ami Wiesel arxiv

Toeplitz covariance estimation is a classical problem in statistical signal processing, yet the geometry of the Gaussian maximum-likelihood objective remains only partially understood. Recent algorithms, including Newton…

Carathéodory Sampling for Stochastic Gradient Descent

2020-06-02 · Francesco Cosentino, Harald Oberhauser, Alessandro Abate

Many problems require to optimize empirical risk functions over large data sets. Gradient descent methods that calculate the full gradient in every descent step do not scale to such datasets. Various flavours of Stochast…

Fast and Accurate Least-Mean-Squares Solvers

2019-06-11 · NeurIPS 2019 12 · Alaa Maalouf, Ibrahim Jubran, Dan Feldman

Least-mean squares (LMS) solvers such as Linear / Ridge / Lasso-Regression, SVD and Elastic-Net not only solve fundamental machine learning problems, but are also the building blocks in a variety of other methods, such a…

Data Summarization

Sparse Approximate Conic Hulls

2017-12-01 · NeurIPS 2017 12 · Greg Van Buskirk, Benjamin Raichel, Nicholas Ruozzi

We consider the problem of computing a restricted nonnegative matrix factorization (NMF) of an m\times n matrix X. Specifically, we seek a factorization X\approx BC, where the k columns of B are a subset of those from X…

feature selection