paper-with-me

홈 › Papers

Near-Optimal Sample Complexity Bounds for Maximum Likelihood Estimation of Multivariate Log-concave Densities

2018-02-28 · Timothy Carpenter, Ilias Diakonikolas, Anastasios Sidiropoulos, Alistair Stewart

We study the problem of learning multivariate log-concave densities with respect to a global loss function. We obtain the first upper bound on the sample complexity of the maximum likelihood estimator (MLE) for a log-concave density on $\mathbb{R}^d$, for all $d \geq 4$. Prior to this work, no finite sample upper bound was known for this estimator in more than $3$ dimensions. In more detail, we prove that for any $d \geq 1$ and $\epsilon>0$, given $\tilde{O}_d((1/\epsilon)^{(d+3)/2})$ samples drawn from an unknown log-concave density $f_0$ on $\mathbb{R}^d$, the MLE outputs a hypothesis $h$ that with high probability is $\epsilon$-close to $f_0$, in squared Hellinger loss. A sample complexity lower bound of $\Omega_d((1/\epsilon)^{(d+1)/2})$ was previously known for any learning algorithm that achieves this guarantee. We thus establish that the sample complexity of the log-concave MLE is near-optimal, up to an $\tilde{O}(1/\epsilon)$ factor.

📄 PDF Abstract BibTeX arXiv:1802.10575

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Near Instance-Optimal PAC Reinforcement Learning for Deterministic MDPs

2022-03-17 · Andrea Tirinzoni, Aymen Al-Marjani, Emilie Kaufmann

In probably approximately correct (PAC) reinforcement learning (RL), an agent is required to identify an $\epsilon$-optimal policy with probability $1-\delta$. While minimax optimal algorithms exist for this problem, its…

reinforcement-learningReinforcement LearningReinforcement Learning (RL)

Near optimal sample complexity for matrix and tensor normal models via geodesic convexity

2021-10-14 · Cole Franks, Rafael Oliveira, Akshay Ramachandran, Michael Walter

The matrix normal model, the family of Gaussian matrix-variate distributions whose covariance matrix is the Kronecker product of two lower dimensional factors, is frequently used to model matrix-variate data. The tensor …

Sample Complexity Bounds for Linear System Identification from a Finite Set

2024-09-17 · Nicolas Chatzikiriakos, Andrea Iannelli

This paper considers a finite sample perspective on the problem of identifying an LTI system from a finite set of possible systems using trajectory data. To this end, we use the maximum likelihood estimator to identify t…

Bayesian Optimization from Human Feedback: Near-Optimal Regret Bounds

2025-05-29 · Aya Kayal, Sattar Vakili, Laura Toni, Da-Shan Shiu 외

Bayesian optimization (BO) with preference-based feedback has recently garnered significant attention due to its emerging applications. We refer to this problem as Bayesian Optimization from Human Feedback (BOHF), which …

Bayesian Optimization

Sample Complexity Bounds for Stochastic Shortest Path with a Generative Model

2026-04-17 · Jean Tarbouriech, Matteo Pirotta, Michal Valko, Alessandro Lazaric arxiv

We study the sample complexity of learning an $ε$-optimal policy in the Stochastic Shortest Path (SSP) problem. We first derive sample complexity bounds when the learner has access to a generative model. We show that the…