Bayesian Consistency with the Supremum Metric
We present simple conditions for Bayesian consistency in the supremum metric. The key to the technique is a triangle inequality which allows us to explicitly use weak convergence, a consequence of the standard Kullback--Leibler support condition for the prior. A further condition is to ensure that smoothed versions of densities are not too far from the original density, thus dealing with densities which could track the data too closely. A key result of the paper is that we demonstrate supremum consistency using weaker conditions compared to those currently used to secure $\mathbb{L}_1$ consistency.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
The Consistency of Adversarial Training for Binary Classification
Robustness to adversarial perturbations is of paramount concern in modern machine learning. One of the state-of-the-art methods for training robust classifiers is adversarial training, which involves minimizing a supremu…
BIG-bench Machine LearningBinary ClassificationClassificationFrequentist coverage and sup-norm convergence rate in Gaussian process regression
Gaussian process (GP) regression is a powerful interpolation technique due to its flexibility in capturing non-linearity. In this paper, we provide a general framework for understanding the frequentist coverage of point-…
regressionRelaxed Triangle Inequality for Kullback-Leibler Divergence Between Multivariate Gaussian Distributions
The Kullback-Leibler (KL) divergence is not a proper distance metric and does not satisfy the triangle inequality, posing theoretical challenges in certain practical applications. Existing work has demonstrated that KL d…
Out-of-Distribution DetectionReinforcement LearningMetric of Shock Severity
Shock response spectrum (SRS) is a widely accepted method for shock testing specification. However, SRS, as a supremum, is over-conservative and cannot fully describe the relative severity for various shock environments.…
An Approach to Colour Morphological Supremum Formation using the LogSumExp Approximation
Mathematical morphology is a part of image processing that has proven to be fruitful for numerous applications. Two main operations in mathematical morphology are dilation and erosion. These are based on the construction…