paper-with-me

홈 › Papers

Lost in the Folds: When Cross-Validation Is Not a Deep Ensemble for Uncertainty Estimation

2026-05-18 · Tristan Kirscher, Markus Bujotzek, Yannick Kirchhoff, Maximilian Rokuss, Fabian Isensee, Kim-Celine Kahl, Balint Kovacs, Klaus Maier-Hein arxiv

Ensemble disagreement is widely used as a proxy for epistemic uncertainty in medical image segmentation. In practice, many studies form ensembles via K-fold cross-validation (CV), yet refer to them as ``deep ensembles'' (DE). Because CV members are trained on different data subsets, their disagreement mixes seed-driven variability with data-exposure effects, which can change how uncertainty should be interpreted. We audit recent segmentation uncertainty studies and find that terminology--implementation mismatches are common. We then compare a standard 5-fold CV ensemble to a 5-member DE (fixed training set, different random seeds) under otherwise identical configurations on three multi-rater segmentation datasets spanning three modalities. We evaluate uncertainty for calibration, failure detection, ambiguity modeling, and robustness under distribution shift. DE match segmentation accuracy while improving calibration and failure detection, whereas CV ensembles sometimes correlate more strongly with inter-rater variability on the studied datasets. Thus, ensemble construction should be chosen to match the research question: DE for reliability-oriented use (e.g., selective referral/failure detection) and CV ensembles as a proxy for ambiguity. We provide a lightweight nnU-Net modification enabling DE training within the default pipeline.

📄 PDF Abstract BibTeX arXiv:2605.18329

Code (0)

등록된 구현이 없습니다.

Tasks

Medical Image Segmentation

Similar Papers 제목 키워드 기반

Classification of Viral Pneumonia X-ray Images with the Aucmedi Framework

2021-10-03 · Pia Schneider, Dominik Müller, Frank Kramer

In this work we use the AUCMEDI-Framework to train a deep neural network to classify chest X-ray images as either normal or viral pneumonia. Stratified k-fold cross-validation with k=3 is used to generate the validation-…

Explainable artificial intelligenceExplainable Artificial Intelligence (XAI)

Assessing nnU-Net Generalization across Brain Tumor Populations in BraTS-GoAT 2026

2026-09-14 · Tristan Kirscher, Vivian Metzger, Philippe Meyer, Xavier Coubez hf

BraTS-GoAT evaluates tumor segmentation across heterogeneous populations. We trained a conventional 3D nnU-Net on 1,351 labeled cases using five-fold cross-validation and 1,000 epochs per fold. The final predictor averag…

Tumor Segmentation

From Theory to Practice: Implementing and Evaluating e-Fold Cross-Validation

2024-10-12 · Christopher Mahlich, Tobias Vente, Joeran Beel

This paper introduces e-fold cross-validation, an energy-efficient alternative to k-fold cross-validation. It dynamically adjusts the number of folds based on a stopping criterion. The criterion checks after each fold wh…

Minimax Limits of k-Fold Cross-Validation via Majority

2026-05-25 · Ido Nachum, Rüdiger Urbanke, Thomas Weinberger arxiv

We study the mean-squared error of $k$-fold cross-validation as a risk estimator, with particular emphasis on how its accuracy depends on the number of folds $k$. Despite the widespread use of cross-validation, principle…

Binary Classification

Crossing the Validation Crisis: Cross-Validation Reduces Benchmarking Variance Surprisingly Well

2026-06-10 · Célestin Eve, Gaël Varoquaux, Thomas Moreau arxiv

Modern machine learning progresses through empirical work, benchmarking new methods to evaluate relative performance. However, the statistical variability inherent to evaluation - exacerbated by the stochastic nature of …

Data Augmentation