Interactive Elicitation of Knowledge on Feature Relevance Improves Predictions in Small Data Sets
Providing accurate predictions is challenging for machine learning algorithms when the number of features is larger than the number of samples in the data. Prior knowledge can improve machine learning models by indicating relevant variables and parameter values. Yet, this prior knowledge is often tacit and only available from domain experts. We present a novel approach that uses interactive visualization to elicit the tacit prior knowledge and uses it to improve the accuracy of prediction models. The main component of our approach is a user model that models the domain expert's knowledge of the relevance of different features for a prediction task. In particular, based on the expert's earlier input, the user model guides the selection of the features on which to elicit user's knowledge next. The results of a controlled user study show that the user model significantly improves prior knowledge elicitation and prediction accuracy, when predicting the relative citation counts of scientific documents in a specific domain.
Code (0)
등록된 구현이 없습니다.
Tasks
BIG-bench Machine LearningPredictionSmall Data Image ClassificationSimilar Papers 제목 키워드 기반
Interactive Prior Elicitation of Feature Similarities for Small Sample Size Prediction
Regression under the "small $n$, large $p$" conditions, of small sample size $n$ and large number of features $p$ in the learning data set, is a recurring setting in which learning from data is difficult. With prior know…
PredictionregressionUser Modelling for Avoiding Overfitting in Interactive Knowledge Elicitation for Prediction
In human-in-the-loop machine learning, the user provides information beyond that in the training data. Many algorithms and user interfaces have been designed to optimize and facilitate this human--machine interaction; ho…
BIG-bench Machine LearningSentiment AnalysisDynamic Visual Analytics for Elicitation Meetings with ELICA
Requirements elicitation can be very challenging in projects that require deep domain knowledge about the system at hand. As analysts have the full control over the elicitation process, their lack of knowledge about the …
PACE: Persona Adaptation through Conversational Elicitation in Human-Robot Interaction
Equipping humanoid robots with coherent and adaptable personas is crucial for fostering natural, engaging, and trustworthy human-robot interaction (HRI). However, existing approaches often rely on static, hard-coded iden…
Knowledge Elicitation via Sequential Probabilistic Inference for High-Dimensional Prediction
Prediction in a small-sized sample with a large number of covariates, the "small n, large p" problem, is challenging. This setting is encountered in multiple applications, such as precision medicine, where obtaining addi…
PredictionregressionVocal Bursts Intensity Prediction