paper-with-me

Papers

Testing hypotheses via orthogonalization

2026-06-29 · Ameer Dharamshi, Runjia Zou, Daniela Witten arxiv

Classical hypothesis testing frameworks break down in contemporary settings in which null hypotheses are increasingly abstract, the same data are used to both generate and test hypotheses, and minimal assumptions about the underlying data are made. In this work, we propose a new framework for conducting valid hypothesis tests in broad contexts. We propose to add and subtract external noise generated from a symmetric shift-family to our data, $X$, to partition it into two pieces, $X^{(1)}$ and $X^{(2)}$. We provide a generic strategy for orthogonalizing $X^{(2)}$ against $X^{(1)}$ under the null hypothesis $H_0$, then show that testing whether the orthogonalization was successful provides a valid test of $H_0$ under mild assumptions. Remarkably, this framework extends naturally to the post-selection inference setting: we simply select a hypothesis on $X^{(1)}$, then perform orthogonalization under the selected null. As our approach neither requires pre-specification of the selection mechanism, nor is restricted to a small class of data-generating distributions, it dramatically expands the settings for which valid post-selection inference can be conducted. We showcase the flexibility of our proposal in several case studies involving challenging pre-specified null hypotheses and post-selection inference scenarios.

📄 PDF Abstract BibTeX arXiv:2606.29732

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Hypothesis Testing over Observable Regimes in Singular Models

2026-02-27 · Sean Plummer arxiv

Hypothesis testing in singular statistical models is often regarded as inherently problematic due to non-identifiability and degeneracy of the Fisher information. We show that the fundamental obstruction to testing in su…

HypoML: Visual Analysis for Hypothesis-based Evaluation of Machine Learning Models

2020-02-12 · Qianwen Wang, William Alexander, Jack Pegg, Huamin Qu 외

In this paper, we present a visual analytics tool for enabling hypothesis-based evaluation of machine learning (ML) models. We describe a novel ML-testing framework that combines the traditional statistical hypothesis te…

BIG-bench Machine LearningLogical ReasoningTwo-sample testing

Data-adaptive statistics for multiple hypothesis testing in high-dimensional settings

2017-04-24 · Weixin Cai, Nima S. Hejazi, Alan E. Hubbard

Current statistical inference problems in areas like astronomy, genomics, and marketing routinely involve the simultaneous testing of thousands -- even millions -- of null hypotheses. For high-dimensional multivariate di…

AstronomyMarketingTwo-sample testingvalid+1

A unified treatment of multiple testing with prior knowledge using the p-filter

2017-03-18 · Aaditya Ramdas, Rina Foygel Barber, Martin J. Wainwright, Michael. I. Jordan

There is a significant literature on methods for incorporating knowledge into multiple testing procedures so as to improve their power and precision. Some common forms of prior knowledge include (a) beliefs about which h…

MuonBP: Faster Muon via Block-Periodic Orthogonalization

2025-10-19 · Ahmed Khaled, Kaan Ozkara, Tao Yu, Mingyi Hong 외 arxiv

Gradient orthogonalization is a simple strategy that shows great utility in speeding up gradient descent. The Muon optimizer (Jordan, Jin, et al., 2024) combines gradient orthogonalization with first-order momentum and a…