Information Gap and Feasibility-Aware Inference in Binomial Logistic Mixtures
This paper studies the information gap between mixture detection and label recovery in binomial logistic mixtures. Standard likelihood-based criteria such as the Bayesian information criterion (BIC) can detect the presence of two components, but this does not guarantee that the corresponding labels are recoverable. We show that this gap is intrinsic to binomial logistic mixtures with a fixed number of trials: observed-data evidence for mixture structure and per-observation information for label recovery have different local orders in the component separation, and only the former accumulates with the sample size. As a result, there exists a detectable-but-unrecoverable regime in which BIC selects two components while the posterior labels remain essentially uninformative. To address this issue, we propose two feasibility-aware inference procedures: a recoverability-aware BIC with a posterior-entropy penalty and an entropy-regularized estimator that mitigates the tendency of the maximum likelihood estimator to produce overly separated components and overly concentrated posterior responsibilities. Numerical experiments confirm the predicted gap and demonstrate that the proposed methods avoid misleading component selections and improve the calibration of posterior label probabilities.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Bayesian inference for logistic models using Polya-Gamma latent variables
We propose a new data-augmentation strategy for fully Bayesian inference in models with binomial likelihoods. The approach appeals to a new class of Polya-Gamma distributions, which are constructed in detail. A variety o…
Bayesian InferenceComputational EfficiencyData AugmentationNumerical Integration+1Fast Bayesian Variable Selection in Binomial and Negative Binomial Regression
Bayesian variable selection is a powerful tool for data analysis, as it offers a principled method for variable selection that accounts for prior information and uncertainty. However, wider adoption of Bayesian variable …
regressionVariable SelectionA q-binomial extension of the CRR asset pricing model
We propose an extension of the Cox-Ross-Rubinstein (CRR) model based on $q$-binomial (or Kemp) random walks, with application to default with logistic failure rates. This model allows us to consider time-dependent switch…
Inferring Outcome Means of Exponential Family Distributions Estimated by Deep Neural Networks
While deep neural networks (DNNs) are widely used for prediction, inference on DNN-estimated subject-specific means for categorical or exponential family outcomes remains underexplored. We address this by proposing a DNN…
regressionSome New Results for Poisson Binomial Models
We consider a problem of ecological inference, in which individual-level covariates are known, but labeled data is available only at the aggregate level. The intended application is modeling voter preferences in election…
Computational Efficiency