Universally consistent predictive distributions
This paper describes simple universally consistent procedures of probability forecasting that satisfy a natural property of small-sample validity, under the assumption that the observations are produced independently in the IID fashion.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Differentially-Private Bayes Consistency
We construct a universally Bayes consistent learning rule that satisfies differential privacy (DP). We first handle the setting of binary classification and then extend our rule to the more general setting of density est…
Binary ClassificationDensity EstimationUniversally Consistent Online Learning with Arbitrarily Dependent Responses
This work provides an online learning rule that is universally consistent under processes on (X,Y) pairs, under conditions only on the X process. As a special case, the conditions admit all processes on (X,Y) such that t…
Training Two-Layer ReLU Networks with Gradient Descent is Inconsistent
We prove that two-layer (Leaky)ReLU networks initialized by e.g. the widely used method proposed by He et al. (2015) and trained using gradient descent on a least-squares loss are not universally consistent. Specifically…
Vocal Bursts Valence PredictionA partition-based similarity for classification distributions
Herein we define a measure of similarity between classification distributions that is both principled from the perspective of statistical pattern recognition and useful from the perspective of machine learning practition…
ClassificationGeneral ClassificationSemantic SimilaritySemantic Textual SimilarityPredictive Uncertainty Quantification via Risk Decompositions for Strictly Proper Scoring Rules
Uncertainty quantification in predictive modeling often relies on ad hoc methods as there is no universally accepted formal framework for that. This paper introduces a theoretical approach to understanding uncertainty th…
Uncertainty Quantification