Bayesian Multiplicity Correction in the Probabilistic Forward Stepwise Framework
We develop a natural Bayesian multiplicity-correcting prior distribution within the probabilistic forward stepwise representation of model space priors for regression problems. The proposed prior, obtained from making an analogy to the Holm procedure, exhibits behavior closely aligned with that of the Matryoshka doll prior. We compare both priors to several other priors, including some recently put forward as objective choices for model space prior probabilities. Our comparisons indicate that adequate multiplicity correction requires a degree of sparsity that many recommended priors do not provide, and we argue that multiplicity correction itself offers a principled and transparent criterion for specifying model space priors in regression.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Sparse Bayesian Learning via Stepwise Regression
Sparse Bayesian Learning (SBL) is a powerful framework for attaining sparsity in probabilistic models. Herein, we propose a coordinate ascent algorithm for SBL termed Relevance Matching Pursuit (RMP) and show that, as it…
feature selectionregressionRashomon Capacity: A Metric for Predictive Multiplicity in Classification
Predictive multiplicity occurs when classification models with statistically indistinguishable performances assign conflicting predictions to individual samples. When used for decision-making in applications of consequen…
ClassificationDecision MakingPredictive Multiplicity in Probabilistic Classification
Machine learning models are often used to inform real world risk assessment tasks: predicting consumer default risk, predicting whether a person suffers from a serious illness, or predicting a person's risk to appear in …
ClassificationCalibrating Probabilistic Embeddings for Cross-Modal Retrieval
The core of cross-modal retrieval is to measure the content similarity between data of different modalities. The main challenge focuses on learning a shared representation space for multiple modalities where the similar…
Cross-Modal RetrievalRetrievalMitigating the Multiplicity Burden: The Role of Calibration in Reducing Predictive Multiplicity of Classifiers
As machine learning models are increasingly deployed in high-stakes environments, ensuring both probabilistic reliability and prediction stability has become critical. This paper examines the interplay between classifica…