paper-with-me

홈 › Papers

A View on Out-of-Distribution Identification from a Statistical Testing Theory Perspective

2024-05-05 · Alberto Caron, Chris Hicks, Vasilios Mavroudis

We study the problem of efficiently detecting Out-of-Distribution (OOD) samples at test time in supervised and unsupervised learning contexts. While ML models are typically trained under the assumption that training and test data stem from the same distribution, this is often not the case in realistic settings, thus reliably detecting distribution shifts is crucial at deployment. We re-formulate the OOD problem under the lenses of statistical testing and then discuss conditions that render the OOD problem identifiable in statistical terms. Building on this framework, we study convergence guarantees of an OOD test based on the Wasserstein distance, and provide a simple empirical evaluation.

📄 PDF Abstract BibTeX arXiv:2405.03052

Code (1)

albicaron/ood_test 공식 구현 pytorch

Similar Papers 제목 키워드 기반

Unsupervised neural adaptation model based on optimal transport for spoken language identification

2020-12-24 · Xugang Lu, Peng Shen, Yu Tsao, Hisashi Kawai

Due to the mismatch of statistical distributions of acoustic speech between training and testing sets, the performance of spoken language identification (SLID) could be drastically degraded. In this paper, we propose an …

Language IdentificationSpoken language identification

Identification and Statistical Decision Theory

2022-04-24 · Charles F. Manski

Econometricians have usefully separated study of estimation into identification and statistical components. Identification analysis, which assumes knowledge of the probability distribution generating observable data, pla…

Decision Making

Optimal Statistical Hypothesis Testing for Social Choice

2020-06-19 · Lirong Xia

We address the following question in this paper: "What are the most robust statistical methods for social choice?'' By leveraging the theory of uniformly least favorable distributions in the Neyman-Pearson framework to f…

Two-sample testing

Identification Methods With Arbitrary Interventional Distributions as Inputs

2020-04-02 · Jaron J. R. Lee, Ilya Shpitser

Causal inference quantifies cause-effect relationships by estimating counterfactual parameters from data. This entails using \emph{identification theory} to establish a link between counterfactual parameters of interest …

Causal Inferencecounterfactual

Statistical Learning Theory for Control: A Finite Sample Perspective

2022-09-12 · Anastasios Tsiamis, Ingvar Ziemann, Nikolai Matni, George J. Pappas

This tutorial survey provides an overview of recent non-asymptotic advances in statistical learning theory as relevant to control and system identification. While there has been substantial progress across all areas of c…

Learning Theory