MetaStackVis: Visually-Assisted Performance Evaluation of Metamodels
Stacking (or stacked generalization) is an ensemble learning method with one main distinctiveness from the rest: even though several base models are trained on the original data set, their predictions are further used as input data for one or more metamodels arranged in at least one extra layer. Composing a stack of models can produce high-performance outcomes, but it usually involves a trial-and-error process. Therefore, our previously developed visual analytics system, StackGenVis, was mainly designed to assist users in choosing a set of top-performing and diverse models by measuring their predictive performance. However, it only employs a single logistic regression metamodel. In this paper, we investigate the impact of alternative metamodels on the performance of stacking ensembles using a novel visualization tool, called MetaStackVis. Our interactive tool helps users to visually explore different singular and pairs of metamodels according to their predictive probabilities and multiple validation metrics, as well as their ability to predict specific problematic data instances. MetaStackVis was evaluated with a usage scenario based on a medical data set and via expert interviews.
Code (0)
등록된 구현이 없습니다.
Tasks
Ensemble LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Probabilistic Metamodels for an Efficient Characterization of Complex Driving Scenarios
To validate the safety of automated vehicles (AV), scenario-based testing aims to systematically describe driving scenarios an AV might encounter. In this process, continuous inputs such as velocities result in an infini…
Gaussian ProcessesProbabilistic Deep LearningExploring the potential of transfer learning for metamodels of heterogeneous material deformation
From the nano-scale to the macro-scale, biological tissue is spatially heterogeneous. Even when tissue behavior is well understood, the exact subject specific spatial distribution of material properties is often unknown.…
CPUTransfer LearningA Review on Quantile Regression for Stochastic Computer Experiments
We report on an empirical study of the main strategies for quantile regression in the context of stochastic computer experiments. To ensure adequate diversity, six metamodels are presented, divided into three categories …
Diversityquantile regressionregressionIntuitive and Formal Transparency in Annotation Schemes
This paper explores the application of the notion of ‘transparency’ to annotation schemes, understood as the properties that make it easy for potential users to see the scope of the scheme, the main concepts used in anno…
RelationA numerical-informational approach for characterising the ductile behaviour of the T-stub component. Part 2: Parsimonious soft-computing-based metamodel
The accuracy of the component-based method relies heavily on the characteristic response of their constitutive elements. To properly assess the deformation capacity of the whole connection, modelling the complete force-d…
feature selection