A Cautionary Tale of Decorrelating Theory Uncertainties
A variety of techniques have been proposed to train machine learning classifiers that are independent of a given feature. While this can be an essential technique for enabling background estimation, it may also be useful for reducing uncertainties. We carefully examine theory uncertainties, which typically do not have a statistical origin. We will provide explicit examples of two-point (fragmentation modeling) and continuous (higher-order corrections) uncertainties where decorrelating significantly reduces the apparent uncertainty while the actual uncertainty is much larger. These results suggest that caution should be taken when using decorrelation for these types of uncertainties as long as we do not have a complete decomposition into statistically meaningful components.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Feature Selection from High-Dimensional Data with Very Low Sample Size: A Cautionary Tale
In classification problems, the purpose of feature selection is to identify a small, highly discriminative subset of the original feature set. In many applications, the dataset may have thousands of features and only a f…
feature selectionDid they direct the violence or admonish it? A cautionary tale on contronomy, androcentrism and back-translation foibles
The recent raft of high-profile gaffes involving neural machine translation technology has brought to light the unreliability and brittleness of this fledgling technology. These revelations have worryingly coincided with…
Machine TranslationTranslationCautionary Tales on Air-Quality Improvement in Beijing
The official air-quality statistic reported that Beijing had a 9.9% decline in the annual concentration of PM2.5 in 2016. While this statistic offered some relief for the inhabitants of the capital, we present several an…
Towards Understanding Gradient Approximation in Equality Constrained Deep Declarative Networks
We explore conditions for when the gradient of a deep declarative node can be approximated by ignoring constraint terms and still result in a descent direction for the global loss function. This has important practical a…
Asset Trading in Continuous Time: A Cautionary Tale
The continuous time model of dynamic asset trading is the central model of modern finance. Because trading cannot in fact take place at every moment of time, it would seem desirable to show that the continuous time model…