Selecting Classifiers by Pooling over Cross-Validation Results in More Consistency in Small-Sample Classification of Atrial Flutter Localization
Selecting learning machines such as classifiers is an important task when using AI in the clinic. K-fold crossvalidation is a practical technique that allows simple inference of such machines. However, the recipe generates many models and does not provide a means to determine the best one. In this paper, a modified recipe is presented, that generates more consistent machines with similar on-average performance, but less extra-sample loss variance and less feature bias. A use case is provided by applying the recipe onto the atrial flutter localization problem.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Nested cross-validation when selecting classifiers is overzealous for most practical applications
When selecting a classification algorithm to be applied to a particular problem, one has to simultaneously select the best algorithm for that dataset \emph{and} the best set of hyperparameters for the chosen model. The u…
Pooling homogeneous ensembles to build heterogeneous ones
In ensemble methods, the outputs of a collection of diverse classifiers are combined in the expectation that the global prediction be more accurate than the individual ones. Heterogeneous ensembles consist of predictors …
Improved cross-validation for classifiers that make algorithmic choices to minimise runtime without compromising output correctness
Our topic is the use of machine learning to improve software by making choices which do not compromise the correctness of the output, but do affect the time taken to produce such output. We are particularly concerned wit…
Understanding Matrix Function Normalizations in Covariance Pooling through the Lens of Riemannian Geometry
Global Covariance Pooling (GCP) has been demonstrated to improve the performance of Deep Neural Networks (DNNs) by exploiting second-order statistics of high-level representations. GCP typically performs classification o…
Temporal cross-validation impacts multivariate time series subsequence anomaly detection evaluation
Evaluating anomaly detection in multivariate time series (MTS) requires careful consideration of temporal dependencies, particularly when detecting subsequence anomalies common in fault detection scenarios. While time se…
Anomaly DetectionBenchmarkingFault DetectionTime Series