paper-with-me

홈 › Papers

Optimal Anytime-Valid Tests for Composite Nulls

2025-12-23 · Shubhanshu Shekhar arxiv

We consider the problem of designing optimal level-$α$ power-one tests for composite nulls. Given a parameter $α\in (0,1)$ and a stream of $\mathcal{X}$-valued observations $\{X_n: n \geq 1\} \overset{i.i.d.}{\sim} P$, the goal is to design a level-$α$ power-one test $τ_α$ for the null $H_0: P \in \mathcal{P}_0 \subset \mathcal{P}(\mathcal{X})$. Prior works have shown that any such $τ_α$ must satisfy $\mathbb{E}_P[τ_α] \geq \tfrac{\log(1/α)}{γ^*(P, \mathcal{P}_0)}$, where $γ^*(P, \mathcal{P}_0)$ is the so-called $\mathrm{KL}_{\inf}$ or minimum divergence of $P$ to the null class. In this paper, our objective is to develop and analyze constructive schemes that match this lower bound as $α\downarrow 0$. We first consider the finite-alphabet case~($|\mathcal{X}| = m < \infty$), and show that a test based on \emph{universal} $e$-process~(formed by the ratio of a universal predictor and the running null MLE) is optimal in the above sense. The proof relies on a Donsker-Varadhan~(DV) based saddle-point representation of $\mathrm{KL}_{\inf}$, and an application of Sion's minimax theorem. This characterization motivates a general method for arbitrary $\mathcal{X}$: construct an $e$-process based on the empirical solutions to the saddle-point representation over a sufficiently rich class of test functions. We give sufficient conditions for the optimality of this test for compact convex nulls, and verify them for Hölder smooth density models. We end the paper with a discussion on the computational aspects of implementing our proposed tests in some practical settings.

📄 PDF Abstract BibTeX arXiv:2512.20039

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Variable Selection with the Knockoffs: Composite Null Hypotheses

2022-03-06 · Mehrdad Pournaderi, Yu Xiang

The fixed-X knockoff filter is a flexible framework for variable selection with false discovery rate (FDR) control in linear models with arbitrary design matrices (of full column rank) and it allows for finite-sample sel…

Variable Selection

GAAVI: Global Asymptotic Anytime Valid Inference for the Conditional Mean Function

2026-02-08 · Brian M Cho, Raaz Dwivedi, Nathan Kallus arxiv

Inference on the conditional mean function (CMF) is central to tasks from adaptive experimentation to optimal treatment assignment and algorithmic fairness auditing. In this work, we provide a novel asymptotic anytime-va…

Real-time Program Evaluation using Anytime-valid Rank Tests

2025-04-30 · Sam van Meer, Nick W. Koning

Counterfactual mean estimators such as difference-in-differences and synthetic control have grown into workhorse tools for program evaluation. Inference for these estimators is well-developed in settings where all post-t…

counterfactualvalid

Predicting fixed-sample test decisions enables anytime-valid inference

2026-02-14 · Chris Holmes, Stephen Walker arxiv

Statistical hypothesis tests typically use prespecified sample sizes, yet data often arrive sequentially. Interim analyses invalidate classical error guarantees, while existing sequential methods require rigid testing pr…

A Bandit Approach to Multiple Testing with False Discovery Control

2018-09-06 · Kevin Jamieson, Lalit Jain

We propose an adaptive sampling approach for multiple testing which aims to maximize statistical power while ensuring anytime false discovery control. We consider $n$ distributions whose means are partitioned by whether …

Drug Discovery