paper-with-me

Papers

Estimating means of bounded random variables by betting

2020-10-19 · Ian Waudby-Smith, Aaditya Ramdas

This paper derives confidence intervals (CI) and time-uniform confidence sequences (CS) for the classical problem of estimating an unknown mean from bounded observations. We present a general approach for deriving concentration bounds, that can be seen as a generalization and improvement of the celebrated Chernoff method. At its heart, it is based on a class of composite nonnegative martingales, with strong connections to testing by betting and the method of mixtures. We show how to extend these ideas to sampling without replacement, another heavily studied problem. In all cases, our bounds are adaptive to the unknown variance, and empirically vastly outperform existing approaches based on Hoeffding or empirical Bernstein inequalities and their recent supermartingale generalizations. In short, we establish a new state-of-the-art for four fundamental problems: CSs and CIs for bounded means, when sampling with and without replacement.

📄 PDF Abstract BibTeX arXiv:2010.09686

Code (3)

gostevehoward/confseq 공식 구현
wannabesmith/betting-paper-simulations 공식 구현
wannabesmith/confseq 공식 구현

Similar Papers 제목 키워드 기반

On the near-optimality of betting confidence sets for bounded means

2023-10-02 · Shubhanshu Shekhar, Aaditya Ramdas

Constructing nonasymptotic confidence intervals (CIs) for the mean of a univariate distribution from independent and identically distributed (i.i.d.) observations is a fundamental task in statistics. For bounded observat…

Learning to Bet for Horizon-Aware Anytime-Valid Testing

2026-03-20 · Ege Onur Taga, Samet Oymak, Shubhanshu Shekhar arxiv

We develop horizon-aware anytime-valid tests and confidence sequences for bounded means under a strict deadline $N$. Using the betting/e-process framework, we cast horizon-aware betting as a finite-horizon optimal contro…

Reinforcement Learning

Tighter PAC-Bayes Bounds Through Coin-Betting

2023-02-12 · Kyoungseok Jang, Kwang-Sung Jun, Ilja Kuzborskij, Francesco Orabona

We consider the problem of estimating the mean of a sequence of random elements $f(X_1, \theta)$ $, \ldots, $ $f(X_n, \theta)$ where $f$ is a fixed scalar function, $S=(X_1, \ldots, X_n)$ are independent random variables…

Tight relative estimation in the mean of Bernoulli random variables

2022-10-23 · Mark Huber

Given a stream of Bernoulli random variables, consider the problem of estimating the mean of the random variable within a specified relative error with a specified probability of failure. Until now, the Gamma Bernoulli A…

Nonparametric extensions of randomized response for private confidence sets

2022-02-17 · Ian Waudby-Smith, Zhiwei Steven Wu, Aaditya Ramdas

This work derives methods for performing nonparametric, nonasymptotic statistical inference for population means under the constraint of local differential privacy (LDP). Given bounded observations $(X_1, \dots, X_n)$ wi…