Trinary Tools for Continuously Valued Binary Classifiers
Classification methods for binary (yes/no) tasks often produce a continuously valued score. Machine learning practitioners must perform model selection, calibration, discretization, performance assessment, tuning, and fairness assessment. Such tasks involve examining classifier results, typically using summary statistics and manual examination of details. In this paper, we provide an interactive visualization approach to support such continuously-valued classifier examination tasks. Our approach addresses the three phases of these tasks: calibration, operating point selection, and examination. We enhance standard views and introduce task-specific views so that they can be integrated into a multi-view coordination (MVC) system. We build on an existing comparison-based approach, extending it to continuous classifiers by treating the continuous values as trinary (positive, unsure, negative) even if the classifier will not ultimately use the 3-way classification. We provide use cases that demonstrate how our approach enables machine learning practitioners to accomplish key tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
BIG-bench Machine LearningFairnessModel SelectionSimilar Papers 제목 키워드 기반
Trinary Decision Trees for handling missing data
This paper introduces the Trinary decision tree, an algorithm designed to improve the handling of missing data in decision tree regressors and classifiers. Unlike other approaches, the Trinary decision tree does not assu…
Missing ValuesNLP@UIOWA at SemEval-2019 Task 6: Classifying the Crass using Multi-windowed CNNs
This paper proposes a system for OffensEval (SemEval 2019 Task 6), which calls for a system to classify offensive language into several categories. Our system is a text based CNN, which learns only from the provided trai…
Binary ClassificationClassificationGeneral ClassificationReconstruction of r-Regular Objects from Trinary Images
We study digital images of r-regular objects where a pixel is black if it is completely inside the object, white if it is completely inside the complement of the object, and grey otherwise. We call such images trinary. W…
ObjectSemiparametrically efficient estimation of the average linear regression function
Let Y be an outcome of interest, X a vector of treatment measures, and W a vector of pre-treatment control variables. Here X may include (combinations of) continuous, discrete, and/or non-mutually exclusive "treatments".…
regressionOrdinal classification for interval-valued data and interval-valued functional data
The aim of ordinal classification is to predict the ordered labels of the output from a set of observed inputs. Interval-valued data refers to data in the form of intervals. For the first time, interval-valued data and i…
Ordinal Classification