paper-with-me

홈 › Papers

Efficient Robust Proper Learning of Log-concave Distributions

2016-06-09 · Ilias Diakonikolas, Daniel M. Kane, Alistair Stewart

We study the {\em robust proper learning} of univariate log-concave distributions (over continuous and discrete domains). Given a set of samples drawn from an unknown target distribution, we want to compute a log-concave hypothesis distribution that is as close as possible to the target, in total variation distance. In this work, we give the first computationally efficient algorithm for this learning problem. Our algorithm achieves the information-theoretically optimal sample size (up to a constant factor), runs in polynomial time, and is robust to model misspecification with nearly-optimal error guarantees. Specifically, we give an algorithm that, on input $n=O(1/\eps^{5/2})$ samples from an unknown distribution $f$, runs in time $\widetilde{O}(n^{8/5})$, and outputs a log-concave hypothesis $h$ that (with high probability) satisfies $\dtv(h, f) = O(\opt)+\eps$, where $\opt$ is the minimum total variation distance between $f$ and the class of log-concave distributions. Our approach to the robust proper learning problem is quite flexible and may be applicable to many other univariate distribution families.

📄 PDF Abstract BibTeX arXiv:1606.03077

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Sample and Computationally Efficient Learning Algorithms under S-Concave Distributions

2017-03-22 · NeurIPS 2017 12 · Maria-Florina Balcan, Hongyang Zhang

We provide new results for noise-tolerant and sample-efficient learning algorithms under $s$-concave distributions. The new class of $s$-concave distributions is a broad and natural generalization of log-concavity, and i…

Active Learning

Flexible Modeling of Diversity with Strongly Log-Concave Distributions

2019-06-12 · NeurIPS 2019 12 · Joshua Robinson, Suvrit Sra, Stefanie Jegelka

Strongly log-concave (SLC) distributions are a rich class of discrete probability distributions over subsets of some ground set. They are strictly more general than strongly Rayleigh (SR) distributions such as the well-k…

Diversity

Dimensionally Tight Bounds for Second-Order Hamiltonian Monte Carlo

2018-02-24 · NeurIPS 2018 12 · Oren Mangoubi, Nisheeth K. Vishnoi

Hamiltonian Monte Carlo (HMC) is a widely deployed method to sample from high-dimensional distributions in Statistics and Machine learning. HMC is known to run very efficiently in practice and its popular second-order "l…

Variance Reduction for Non-Log-Concave Sampling with Applications to Inverse Problems

2026-06-15 · M. Berk Sahin, Ahmet Ege Tanriverdi, Behzad Sharif, Abolfazl Hashemi arxiv

Sampling from high-dimensional, non-log-concave distributions with unnormalized densities is a fundamental challenge in machine learning, particularly when the exact gradient of the potential is unavailable and must be a…

Complexity of zigzag sampling algorithm for strongly log-concave distributions

2020-12-21 · Jianfeng Lu, Lihan Wang

We study the computational complexity of zigzag sampling algorithm for strongly log-concave distributions. The zigzag process has the advantage of not requiring time discretization for implementation, and that each propo…