Fair Classification via Transformer Neural Networks: Case Study of an Educational Domain
Educational technologies nowadays increasingly use data and Machine Learning (ML) models. This gives the students, instructors, and administrators support and insights for the optimum policy. However, it is well acknowledged that ML models are subject to bias, which raises concerns about the fairness, bias, and discrimination of using these automated ML algorithms in education and its unintended and unforeseen negative consequences. The contribution of bias during the decision-making comes from datasets used for training ML models and the model architecture. This paper presents a preliminary investigation of the fairness of transformer neural networks on the two tabular datasets: Law School and Student-Mathematics. In contrast to classical ML models, the transformer-based models transform these tabular datasets into a richer representation while solving the classification task. We use different fairness metrics for evaluation and check the trade-off between fairness and accuracy of the transformer-based models over the tabular datasets. Empirically, our approach shows impressive results regarding the trade-off between fairness and performance on the Law School dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
Decision MakingFairnessSimilar Papers 제목 키워드 기반
Conceptual Framework and Documentation Standards of Cystoscopic Media Content for Artificial Intelligence
Background: The clinical documentation of cystoscopy includes visual and textual materials. However, the secondary use of visual cystoscopic data for educational and research purposes remains limited due to inefficient d…
ManagementEducational Question Generation of Children Storybooks via Question Type Distribution Learning and Event-Centric Summarization
Generating educational questions of fairytales or storybooks is vital for improving children's literacy ability. However, it is challenging to generate questions that capture the interesting aspects of a fairytale story …
Question AnsweringQuestion GenerationQuestion-GenerationBigger Data or Fairer Data? Augmenting BERT via Active Sampling for Educational Text Classification
Pretrained Language Models (PLMs), though popular, have been diagnosed to encode bias against protected groups in the representations they learn, which may harm the prediction fairness of downstream models. Given that su…
Fairnesstext-classificationText ClassificationTowards Responsible AI in Education: Hybrid Recommendation System for K-12 Students Case Study
The growth of Educational Technology (EdTech) has enabled highly personalized learning experiences through Artificial Intelligence (AI)-based recommendation systems tailored to each student needs. However, these systems …
FairnessRecommendation SystemsQuantifying the Effectiveness of Student Organization Activities using Natural Language Processing
Student extracurricular activities play an important role in enriching the students' educational experiences. With the increasing popularity of Machine Learning and Natural Language Processing, it becomes a logical step …
feature selectionLanguage ModellingLarge Language ModelSentiment Analysis