paper-with-me

Papers

Exploring Fairness in Educational Data Mining in the Context of the Right to be Forgotten

2024-05-27 · Wei Qian, Aobo Chen, Chenxu Zhao, Yangyi Li, Mengdi Huai

In education data mining (EDM) communities, machine learning has achieved remarkable success in discovering patterns and structures to tackle educational challenges. Notably, fairness and algorithmic bias have gained attention in learning analytics of EDM. With the increasing demand for the right to be forgotten, there is a growing need for machine learning models to forget sensitive data and its impact, particularly within the realm of EDM. The paradigm of selective forgetting, also known as machine unlearning, has been extensively studied to address this need by eliminating the influence of specific data from a pre-trained model without complete retraining. However, existing research assumes that interactive data removal operations are conducted in secure and reliable environments, neglecting potential malicious unlearning requests to undermine the fairness of machine learning systems. In this paper, we introduce a novel class of selective forgetting attacks designed to compromise the fairness of learning models while maintaining their predictive accuracy, thereby preventing the model owner from detecting the degradation in model performance. Additionally, we propose an innovative optimization framework for selective forgetting attacks, capable of generating malicious unlearning requests across various attack scenarios. We validate the effectiveness of our proposed selective forgetting attacks on fairness through extensive experiments using diverse EDM datasets.

📄 PDF Abstract BibTeX arXiv:2405.16798

Code (0)

등록된 구현이 없습니다.

Tasks

FairnessMachine Unlearning

Similar Papers 제목 키워드 기반

Evaluation of group fairness measures in student performance prediction problems

2022-08-22 · Tai Le Quy, Thi Huyen Nguyen, Gunnar Friege, Eirini Ntoutsi

Predicting students' academic performance is one of the key tasks of educational data mining (EDM). Traditionally, the high forecasting quality of such models was deemed critical. More recently, the issues of fairness an…

Fairness

Counterfactual Fairness Evaluation of Machine Learning Models on Educational Datasets

2025-04-15 · Woojin Kim, Hyeoncheol Kim

As machine learning models are increasingly used in educational settings, from detecting at-risk students to predicting student performance, algorithmic bias and its potential impacts on students raise critical concerns …

counterfactualFairness

Evaluating Bias in LLMs for Job-Resume Matching: Gender, Race, and Education

2025-03-24 · Hayate Iso, Pouya Pezeshkpour, Nikita Bhutani, Estevam Hruschka

Large Language Models (LLMs) offer the potential to automate hiring by matching job descriptions with candidate resumes, streamlining recruitment processes, and reducing operational costs. However, biases inherent in the…

DiversityFairness

Experts' View on Challenges and Needs for Fairness in Artificial Intelligence for Education

2022-06-23 · Gianni Fenu, Roberta Galici, Mirko Marras

In recent years, there has been a stimulating discussion on how artificial intelligence (AI) can support the science and engineering of intelligent educational applications. Many studies in the field are proposing action…

Fairness

Algorithmic Fairness in Education

2020-07-10 · René F. Kizilcec, Hansol Lee

Data-driven predictive models are increasingly used in education to support students, instructors, and administrators. However, there are concerns about the fairness of the predictions and uses of these algorithmic syste…

Fairness