paper-with-me

홈 › Papers

Rényi-infinity constrained sampling with $d^3$ membership queries

2024-07-17 · Yunbum Kook, Matthew S. Zhang

Uniform sampling over a convex body is a fundamental algorithmic problem, yet the convergence in KL or R\'enyi divergence of most samplers remains poorly understood. In this work, we propose a constrained proximal sampler, a principled and simple algorithm that possesses elegant convergence guarantees. Leveraging the uniform ergodicity of this sampler, we show that it converges in the R\'enyi-infinity divergence ($\mathcal R_\infty$) with no query complexity overhead when starting from a warm start. This is the strongest of commonly considered performance metrics, implying rates in $\{\mathcal R_q, \mathsf{KL}\}$ convergence as special cases. By applying this sampler within an annealing scheme, we propose an algorithm which can approximately sample $\varepsilon$-close to the uniform distribution on convex bodies in $\mathcal R_\infty$-divergence with $\widetilde{\mathcal{O}}(d^3\, \text{polylog} \frac{1}{\varepsilon})$ query complexity. This improves on all prior results in $\{\mathcal R_q, \mathsf{KL}\}$-divergences, without resorting to any algorithmic modifications or post-processing of the sample. It also matches the prior best known complexity in total variation distance.

📄 PDF Abstract BibTeX arXiv:2407.12967

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Sampling from Log-Concave Distributions with Infinity-Distance Guarantees

2021-11-07 · Oren Mangoubi, Nisheeth K. Vishnoi

For a $d$-dimensional log-concave distribution $\pi(\theta) \propto e^{-f(\theta)}$ constrained to a convex body $K$, the problem of outputting samples from a distribution $\nu$ which is $\varepsilon$-close in infinity-d…

Automata Learning from Preference and Equivalence Queries

2023-08-18 · Eric Hsiung, Joydeep Biswas, Swarat Chaudhuri

Active automata learning from membership and equivalence queries is a foundational problem with numerous applications. We propose a novel variant of the active automata learning problem: actively learn finite automata us…

Navigate

Learning Halfspaces With Membership Queries

2020-12-20 · Ori Kelner

Active learning is a subfield of machine learning, in which the learning algorithm is allowed to choose the data from which it learns. In some cases, it has been shown that active learning can yield an exponential gain i…

Active Learning

Learning Boolean Halfspaces with Small Weights from Membership Queries

2014-05-07 · Hasan Abasi, Ali Z. Abdi, Nader H. Bshouty

We consider the problem of proper learning a Boolean Halfspace with integer weights $\{0,1,\ldots,t\}$ from membership queries only. The best known algorithm for this problem is an adaptive algorithm that asks $n^{O(t^5)…

Sampling Attacks: Amplification of Membership Inference Attacks by Repeated Queries

2020-09-01 · Shadi Rahimian, Tribhuvanesh Orekondy, Mario Fritz

Machine learning models have been shown to leak information violating the privacy of their training set. We focus on membership inference attacks on machine learning models which aim to determine whether a data point was…

BIG-bench Machine LearningInference AttackMembership Inference Attack