paper-with-me

홈 › Papers

Informative Label Missingness in Multiclass Classification Information Geometry and Excess Risk

2026-08-31 · Fariborz Setoudehtazang, Geoffrey J. McLachlan arxiv

Informative label missingness can change the usual efficiency ordering between completely and partially labelled classifiers because the pattern of missing labels may itself carry information about the classification model. We develop a general likelihood-based theory for this phenomenon in parametric multiclass classification. An efficient-information decomposition separates information lost through unavailable class memberships from information contributed by the missing-label mechanism. We then derive a quadratic expansion of plug-in excess risk over the active pairwise faces of the multiclass Bayes boundary, showing that classification efficiency depends on how information gains and losses align with directions that perturb the decision boundary. This yields a classification-weighted generalized-eigenvalue criterion under which informative partial classification may have smaller asymptotic classification risk without globally dominating complete classification in Fisher information. Near missing completely at random, with the marginal missing-label proportion fixed, redistribution of missing labels changes lost class-label information at first order, whereas efficient information from the missingness pattern appears only at second order. Three-class quadratic discriminant calculations, finite-sample experiments, and a semi-synthetic multiclass application illustrate the resulting regime-dependent behaviour.

📄 PDF Abstract BibTeX arXiv:2608.30561

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Informative missingness and its implications in semi-supervised learning

2025-12-04 · Jinran Wu, You-Gan Wang, Geoffrey J. McLachlan arxiv

Semi-supervised learning (SSL) constructs classifiers using both labelled and unlabelled data. It leverages information from labelled samples, whose acquisition is often costly or labour-intensive, together with unlabell…

MIPD: Exploring Manipulation and Intention In a Novel Corpus of Polish Disinformation

2024-11-11 · Empirical Methods in Natural Language Processing (EMNLP) 2024 11 · Arkadiusz Modzelewski, Giovanni Da San Martino, Pavel Savov, Magdalena Anna Wilczyńska 외

This study presents a novel corpus of 15,356 Polish web articles, including articles identified as containing disinformation. Our dataset enables a multifaceted understanding of disinformation. We present a distinctive m…

ArticlesClassification

ICYM2I: The illusion of multimodal informativeness under missingness

2025-05-22 · Young Sang Choi, Vincent Jeanselme, Pierre Elias, Shalmali Joshi

Multimodal learning is of continued interest in artificial intelligence-based applications, motivated by the potential information gain from combining different types of data. However, modalities collected and curated du…

Informativeness

Neural ODEs for Informative Missingness in Multivariate Time Series

2020-05-20 · Mansura Habiba, Barak A. Pearlmutter

Informative missingness is unavoidable in the digital processing of continuous time series, where the value for one or more observations at different time points are missing. Such missing observations are one of the majo…

Deep LearningImputationMissing ValuesTime Series+3

Weston-Watkins Hinge Loss and Ordered Partitions

2020-06-12 · NeurIPS 2020 12 · Yutong Wang, Clayton D. Scott

Multiclass extensions of the support vector machine (SVM) have been formulated in a variety of ways. A recent empirical comparison of nine such formulations [Do\v{g}an et al. 2016] recommends the variant proposed by West…