paper-with-me

홈 › Papers

Tight Bounds for Approximate Carathéodory and Beyond

2015-12-29 · ICML 2017 8 · Vahab Mirrokni, Renato Paes Leme, Adrian Vladu, Sam Chiu-wai Wong

We give a deterministic nearly-linear time algorithm for approximating any point inside a convex polytope with a sparse convex combination of the polytope's vertices. Our result provides a constructive proof for the Approximate Carath\'{e}odory Problem, which states that any point inside a polytope contained in the $\ell_p$ ball of radius $D$ can be approximated to within $\epsilon$ in $\ell_p$ norm by a convex combination of only $O\left(D^2 p/\epsilon^2\right)$ vertices of the polytope for $p \geq 2$. We also show that this bound is tight, using an argument based on anti-concentration for the binomial distribution. Along the way of establishing the upper bound, we develop a technique for minimizing norms over convex sets with complicated geometry; this is achieved by running Mirror Descent on a dual convex function obtained via Sion's Theorem. As simple extensions of our method, we then provide new algorithms for submodular function minimization and SVM training. For submodular function minimization we obtain a simplification and (provable) speed-up over Wolfe's algorithm, the method commonly found to be the fastest in practice. For SVM training, we obtain $O(1/\epsilon^2)$ convergence for arbitrary kernels; each iteration only requires matrix-vector operations involving the kernel matrix, so we overcome the obstacle of having to explicitly store the kernel or compute its Cholesky factorization.

📄 PDF Abstract BibTeX arXiv:1512.08602

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

SVM A Support Vector Machine, or SVM, is a non-parametric supervised learning model. For non-linear classification and regression, they utilise the kernel trick to map inputs…

Similar Papers 제목 키워드 기반

Revisiting the Approximate Carathéodory Problem via the Frank-Wolfe Algorithm

2019-11-11 · Cyrille W. Combettes, Sebastian Pokutta

The approximate Carath\'eodory theorem states that given a compact convex set $\mathcal{C}\subset\mathbb{R}^n$ and $p\in\left[2,+\infty\right[$, each point $x^*\in\mathcal{C}$ can be approximated to $\epsilon$-accuracy i…

The Optimization Landscape of Carathéodory Decomposition of Toeplitz Covariances

2025-11-03 · Daniel Busbib, Ami Wiesel arxiv

Toeplitz covariance estimation is a classical problem in statistical signal processing, yet the geometry of the Gaussian maximum-likelihood objective remains only partially understood. Recent algorithms, including Newton…

Carathéodory Sampling for Stochastic Gradient Descent

2020-06-02 · Francesco Cosentino, Harald Oberhauser, Alessandro Abate

Many problems require to optimize empirical risk functions over large data sets. Gradient descent methods that calculate the full gradient in every descent step do not scale to such datasets. Various flavours of Stochast…

Convex Set Disjointness, Distributed Learning of Halfspaces, and LP Feasibility

2019-09-08 · Mark Braverman, Gillat Kol, Shay Moran, Raghuvansh R. Saxena

We study the Convex Set Disjointness (CSD) problem, where two players have input sets taken from an arbitrary fixed domain~$U\subseteq \mathbb{R}^d$ of size $\lvert U\rvert = n$. Their mutual goal is to decide using mini…

Distributed OptimizationLEMMA

Fast and Accurate Least-Mean-Squares Solvers

2019-06-11 · NeurIPS 2019 12 · Alaa Maalouf, Ibrahim Jubran, Dan Feldman

Least-mean squares (LMS) solvers such as Linear / Ridge / Lasso-Regression, SVD and Elastic-Net not only solve fundamental machine learning problems, but are also the building blocks in a variety of other methods, such a…

Data Summarization