paper-with-me

Papers

Near-Optimal Bounds for Binary Embeddings of Arbitrary Sets

2015-12-14 · Samet Oymak, Ben Recht

We study embedding a subset $K$ of the unit sphere to the Hamming cube $\{-1,+1\}^m$. We characterize the tradeoff between distortion and sample complexity $m$ in terms of the Gaussian width $\omega(K)$ of the set. For subspaces and several structured sets we show that Gaussian maps provide the optimal tradeoff $m\sim \delta^{-2}\omega^2(K)$, in particular for $\delta$ distortion one needs $m\approx\delta^{-2}{d}$ where $d$ is the subspace dimension. For general sets, we provide sharp characterizations which reduces to $m\approx{\delta^{-4}}{\omega^2(K)}$ after simplification. We provide improved results for local embedding of points that are in close proximity of each other which is related to locality sensitive hashing. We also discuss faster binary embedding where one takes advantage of an initial sketching procedure based on Fast Johnson-Lindenstauss Transform. Finally, we list several numerical observations and discuss open problems.

📄 PDF Abstract BibTeX arXiv:1512.04433

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Near-tight closure bounds for Littlestone and threshold dimensions

2020-07-07 · Badih Ghazi, Noah Golowich, Ravi Kumar, Pasin Manurangsi

We study closure properties for the Littlestone and threshold dimensions of binary hypothesis classes. Given classes $\mathcal{H}_1, \ldots, \mathcal{H}_k$ of Boolean functions with bounded Littlestone (respectively, thr…

Binary Classification with Bounded Abstention Rate

2019-05-23 · Shubhanshu Shekhar, Mohammad Ghavamzadeh, Tara Javidi

We consider the problem of binary classification with abstention in the relatively less studied \emph{bounded-rate} setting. We begin by obtaining a characterization of the Bayes optimal classifier for an arbitrary input…

Binary ClassificationClassificationGeneral Classification

Compressed Sensing Using Binary Matrices of Nearly Optimal Dimensions

2018-08-09 · Mahsa Lotfi, Mathukumalli Vidyasagar

In this paper, we study the problem of compressed sensing using binary measurement matrices and $\ell_1$-norm minimization (basis pursuit) as the recovery algorithm. We derive new upper and lower bounds on the number of …

compressed sensingCPU

On Algebraic Constructions of Neural Networks with Small Weights

2022-05-17 · Kordag Mehmet Kilic, Jin Sima, Jehoshua Bruck

Neural gates compute functions based on weighted sums of the input variables. The expressive power of neural gates (number of distinct functions it can compute) depends on the weight sizes and, in general, large weights …

LEMMA

SOL: Sampling-based Optimal Linear bounding of arbitrary scalar functions

2023-09-21 · NeurIPS 2023 11

Finding tight linear bounds for activation functions in neural networks is an essential part of several state of the art neural network robustness certification tools. An activation function is an arbitrary, nonlinear, …