paper-with-me

홈 › Papers

Learning Credal Ensembles via Distributionally Robust Optimization

2026-02-09 · Kaizheng Wang, Ghifari Adam Faza, Fabio Cuzzolin, Siu Lun Chau, David Moens, Hans Hallez arxiv

Credal predictors are models that are aware of epistemic uncertainty and produce a convex set of probabilistic predictions. They offer a principled way to quantify predictive epistemic uncertainty (EU) and have been shown to improve model robustness in various settings. However, most state-of-the-art methods mainly define EU as disagreement caused by random training initializations, which mostly reflects sensitivity to optimization randomness rather than uncertainty from deeper sources. To address this, we define EU as disagreement among models trained with varying relaxations of the i.i.d. assumption between training and test data. Based on this idea, we propose CreDRO, which learns an ensemble of plausible models through distributionally robust optimization. As a result, CreDRO captures EU not only from training randomness but also from meaningful disagreement due to potential distribution shifts between training and test data. Empirical results show that CreDRO consistently outperforms existing credal methods on tasks such as out-of-distribution detection across multiple benchmarks and selective classification in medical applications.

📄 PDF Abstract BibTeX arXiv:2602.08470

Code (0)

등록된 구현이 없습니다.

Tasks

Out-of-Distribution Detection

Similar Papers 제목 키워드 기반

Credal Graph Neural Networks

2025-12-02 · Matteo Tolloso, Davide Bacciu arxiv

Uncertainty quantification is essential for deploying reliable Graph Neural Networks (GNNs), where existing approaches primarily rely on Bayesian inference or ensembles. In this paper, we introduce the first credal graph…

Node ClassificationBayesian Inference

Credal Wrapper of Model Averaging for Uncertainty Estimation in Classification

2024-05-23 · Kaizheng Wang, Fabio Cuzzolin, Keivan Shariatmadar, David Moens 외

This paper presents an innovative approach, called credal wrapper, to formulating a credal set representation of model averaging for Bayesian neural networks (BNNs) and deep ensembles (DEs), capable of improving uncertai…

Out-of-Distribution DetectionOut of Distribution (OOD) Detection

Credal Ensemble Distillation for Uncertainty Quantification

2025-11-14 · Kaizheng Wang, Fabio Cuzzolin, David Moens, Hans Hallez arxiv

Deep ensembles (DE) have emerged as a powerful approach for quantifying predictive uncertainty and distinguishing its aleatoric and epistemic components, thereby enhancing model robustness and reliability. However, their…

Out-of-Distribution Detection

CreINNs: Credal-Set Interval Neural Networks for Uncertainty Estimation in Classification Tasks

2024-01-10 · Kaizheng Wang, Keivan Shariatmadar, Shireen Kudukkil Manchingal, Fabio Cuzzolin 외

Effective uncertainty estimation is becoming increasingly attractive for enhancing the reliability of neural networks. This work presents a novel approach, termed Credal-Set Interval Neural Networks (CreINNs), for classi…

Binary ClassificationOut-of-Distribution DetectionUncertainty Quantification

Bulk-Calibrated Credal Ambiguity Sets: Fast, Tractable Decision Making under Out-of-Sample Contamination

2026-01-29 · Mengqi Chen, Thomas B. Berrett, Theodoros Damoulas, Michele Caprio arxiv

Distributionally robust optimisation (DRO) minimises the worst-case expected loss over an ambiguity set that can capture distributional shifts in out-of-sample environments. While Huber (linear-vacuous) contamination is …

Text ClassificationDecision Making