On Binary Classification in Extreme Regions

2018-12-01 · NeurIPS 2018 12 · Hamid Jalalzai, Stephan Clémençon, Anne Sabourin

In pattern recognition, a random label Y is to be predicted based upon observing a random vector X valued in $\mathbb{R}^d$ with d>1 by means of a classification rule with minimum probability of error. In a wide variety of applications, ranging from finance/insurance to environmental sciences through teletraffic data analysis for instance, extreme (i.e. very large) observations X are of crucial importance, while contributing in a negligible manner to the (empirical) error however, simply because of their rarity. As a consequence, empirical risk minimizers generally perform very poorly in extreme regions. It is the purpose of this paper to develop a general framework for classification in the extremes. Precisely, under non-parametric heavy-tail assumptions for the class distributions, we prove that a natural and asymptotic notion of risk, accounting for predictive performance in extreme regions of the input space, can be defined and show that minimizers of an empirical version of a non-asymptotic approximant of this dedicated risk, based on a fraction of the largest observations, lead to classification rules with good generalization capacity, by means of maximal deviation inequalities in low probability regions. Beyond theoretical results, numerical experiments are presented in order to illustrate the relevance of the approach developed.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Binary Classification Classification General Classification

Concentration bounds for the empirical angular measure with statistical learning applications

2021-04-07 · Stéphan Clémençon, Hamid Jalalzai, Stéphane Lhaut, Anne Sabourin 외

The angular measure on the unit sphere characterizes the first-order dependence structure of the components of a random vector in extreme regions and is defined in terms of standardized margins. Its statistical recovery …

Anomaly Detection Binary Classification Unsupervised Anomaly Detection valid

Adaptive kernel-density approach for imbalanced binary classification

2025-10-05 · Kotaro J. Nishimura, Yuichi Sakumura, Kazushi Ikeda arxiv

Class imbalance is a common challenge in real-world binary classification tasks, often leading to predictions biased toward the majority class and reduced recognition of the minority class. This issue is particularly cri…

Binary Classification Density Estimation Anomaly Detection Medical Diagnosis

Semi-Parametric Uncertainty Bounds for Binary Classification

2019-03-23 · Balázs Csanád Csáji, Ambrus Tamás

The paper studies binary classification and aims at estimating the underlying regression function which is the conditional expectation of the class labels given the inputs. The regression function is the key component of…

Binary Classification Classification General Classification regression

EXCON: Extreme Instance-based Contrastive Representation Learning of Severely Imbalanced Multivariate Time Series for Solar Flare Prediction

2024-11-18 · Onur Vural, Shah Muhammad Hamdi, Soukaina Filali Boubrahimi

In heliophysics research, predicting solar flares is crucial due to their potential to impact both space-based systems and Earth's infrastructure substantially. Magnetic field data from solar active regions, recorded by …

Contrastive Learning Prediction Representation Learning Robust classification+2

A novel online multi-label classifier for high-speed streaming data applications

2016-09-01 · Rajasekar Venkatesan, Meng Joo Er, Mihika Dave, Mahardhika Pratama 외

In this paper, a high-speed online neural network classifier based on extreme learning machines for multi-label classification is proposed. In multi-label classification, each of the input data sample belongs to one or m…

Classification General Classification Multi-class Classification Multi-Label Classification+1