An effect analysis of the balancing techniques on the counterfactual explanations of student success prediction models
In the past decade, we have experienced a massive boom in the usage of digital solutions in higher education. Due to this boom, large amounts of data have enabled advanced data analysis methods to support learners and examine learning processes. One of the dominant research directions in learning analytics is predictive modeling of learners' success using various machine learning methods. To build learners' and teachers' trust in such methods and systems, exploring the methods and methodologies that enable relevant stakeholders to deeply understand the underlying machine-learning models is necessary. In this context, counterfactual explanations from explainable machine learning tools are promising. Several counterfactual generation methods hold much promise, but the features must be actionable and causal to be effective. Thus, obtaining which counterfactual generation method suits the student success prediction models in terms of desiderata, stability, and robustness is essential. Although a few studies have been published in recent years on the use of counterfactual explanations in educational sciences, they have yet to discuss which counterfactual generation method is more suitable for this problem. This paper analyzed the effectiveness of commonly used counterfactual generation methods, such as WhatIf Counterfactual Explanations, Multi-Objective Counterfactual Explanations, and Nearest Instance Counterfactual Explanations after balancing. This contribution presents a case study using the Open University Learning Analytics dataset to demonstrate the practical usefulness of counterfactual explanations. The results illustrate the method's effectiveness and describe concrete steps that could be taken to alter the model's prediction.
Code (1)
Tasks
counterfactualSimilar Papers 제목 키워드 기반
A Comparative Analysis of Counterfactual Explanation Methods for Text Classifiers
Counterfactual explanations can be used to interpret and debug text classifiers by producing minimally altered text inputs that change a classifier's output. In this work, we evaluate five methods for generating counterf…
counterfactualCounterfactual ExplanationvalidDECE: Decision Explorer with Counterfactual Explanations for Machine Learning Models
With machine learning models being increasingly applied to various decision-making scenarios, people have spent growing efforts to make machine learning models more transparent and explainable. Among various explanation …
BIG-bench Machine LearningcounterfactualCounterfactual ExplanationDecision MakingExplainable bank failure prediction models: Counterfactual explanations to reduce the failure risk
The accuracy and understandability of bank failure prediction models are crucial. While interpretable models like logistic regression are favored for their explainability, complex models such as random forest, support ve…
counterfactualCounterfactual ExplanationMotif-guided Time Series Counterfactual Explanations
With the rising need of interpretable machine learning methods, there is a necessity for a rise in human effort to provide diverse explanations of the influencing factors of the model decisions. To improve the trust and …
counterfactualCounterfactual ExplanationDecision MakingExplainable artificial intelligence+5TX-Gen: Multi-Objective Optimization for Sparse Counterfactual Explanations for Time-Series Classification
In time-series classification, understanding model decisions is crucial for their application in high-stakes domains such as healthcare and finance. Counterfactual explanations, which provide insights by presenting alter…
counterfactualTime SeriesTime Series Classificationvalid