Optimal classification and generalized prevalence estimates for diagnostic settings with more than two classes
An accurate multiclass classification strategy is crucial to interpreting antibody tests. However, traditional methods based on confidence intervals or receiver operating characteristics lack clear extensions to settings with more than two classes. We address this problem by developing a multiclass classification based on probabilistic modeling and optimal decision theory that minimizes the convex combination of false classification rates. The classification process is challenging when the relative fraction of the population in each class, or generalized prevalence, is unknown. Thus, we also develop a method for estimating the generalized prevalence of test data that is independent of classification. We validate our approach on serological data with severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) na\"ive, previously infected, and vaccinated classes. Synthetic data are used to demonstrate that (i) prevalence estimates are unbiased and converge to true values and (ii) our procedure applies to arbitrary measurement dimensions. In contrast to the binary problem, the multiclass setting offers wide-reaching utility as the most general framework and provides new insight into prevalence estimation best practices.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationDiagnosticMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Analysis of Diagnostics (Part I): Prevalence, Uncertainty Quantification, and Machine Learning
Diagnostic testing provides a unique setting for studying and developing tools in classification theory. In such contexts, the concept of prevalence, i.e. the number of individuals with a given condition, is fundamental,…
DiagnosticLEMMAUncertainty QuantificationAnalysis of Diagnostics (Part II): Prevalence, Linear Independence, and Unsupervised Learning
This is the second manuscript in a two-part series that uses diagnostic testing to understand the connection between prevalence (i.e. number of elements in a class), uncertainty quantification (UQ), and classification th…
DiagnosticUncertainty QuantificationRe-Assessing the "Classify and Count" Quantification Method
Learning to quantify (a.k.a.\ quantification) is a task concerned with training unbiased estimators of class prevalence via supervised learning. This task originated with the observation that "Classify and Count" (CC), t…
General ClassificationSentiment AnalysisSentiment ClassificationInequalities for Optimization of Classification Algorithms: A Perspective Motivated by Diagnostic Testing
Motivated by canonical problems in medical diagnostics, we propose and study properties of an objective function that uniformly bounds uncertainties in quantities of interest extracted from classifiers and related data a…
Pareto Smoothed Importance Sampling
Importance weighting is a general way to adjust Monte Carlo integration to account for draws from the wrong distribution, but the resulting estimate can be highly variable when the importance ratios have a heavy right ta…
Diagnostic