paper-with-me

Papers

AUC optimization and the two-sample problem

2009-12-01 · NeurIPS 2009 12 · Nicolas Vayatis, Marine Depecker, Stéphan J. Clémençcon

The purpose of the paper is to explore the connection between multivariate homogeneity tests and $\auc$ optimization. The latter problem has recently received much attention in the statistical learning literature. From the elementary observation that, in the two-sample problem setup, the null assumption corresponds to the situation where the area under the optimal ROC curve is equal to 1/2, we propose a two-stage testing method based on data splitting. A nearly optimal scoring function in the AUC sense is first learnt from one of the two half-samples. Data from the remaining half-sample are then projected onto the real line and eventually ranked according to the scoring function computed at the first stage. The last step amounts to performing a standard Mann-Whitney Wilcoxon test in the one-dimensional framework. We show that the learning step of the procedure does not affect the consistency of the test as well as its properties in terms of power, provided the ranking produced is accurate enough in the AUC sense. The results of a numerical experiment are eventually displayed in order to show the efficiency of the method.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Vocal Bursts Valence Prediction

Similar Papers 제목 키워드 기반

Non-native Quantum Generative Optimization with Adversarial Autoencoders

2024-07-18 · Blake A. Wilson, Jonathan Wurtz, Vahagn Mkhitaryan, Michael Bezick 외

Large-scale optimization problems are prevalent in several fields, including engineering, finance, and logistics. However, most optimization problems cannot be efficiently encoded onto a physical system because the exist…

Optimal Representative Sample Weighting

2020-05-18 · Shane Barratt, Guillermo Angeris, Stephen Boyd

We consider the problem of assigning weights to a set of samples or data records, with the goal of achieving a representative weighting, which happens when certain sample averages of the data are close to prescribed valu…

Contextual Learning for Stochastic Optimization

2025-05-22 · Anna Heuser, Thomas Kesselheim

Motivated by stochastic optimization, we introduce the problem of learning from samples of contextual value distributions. A contextual value distribution can be understood as a family of real-valued distributions, where…

Stochastic Optimization

A Single-Timescale Method for Stochastic Bilevel Optimization

2021-02-09 · Tianyi Chen, Yuejiao Sun, Quan Xiao, Wotao Yin

Stochastic bilevel optimization generalizes the classic stochastic optimization from the minimization of a single objective to the minimization of an objective function that depends the solution of another optimization p…

Bilevel OptimizationMeta-LearningStochastic Optimization

Optimization from Structured Samples for Coverage Functions

2020-07-06 · ICML 2020 1 · Wei Chen, Xiaoming Sun, Jialin Zhang, Zhijie Zhang

We revisit the optimization from samples (OPS) model, which studies the problem of optimizing objective functions directly from the sample data. Previous results showed that we cannot obtain a constant approximation rati…

Computational Efficiency