Deep Learning for School Dropout Detection: A Comparison of Tabular and Graph-Based Models for Predicting At-Risk Students
Student dropout is a significant challenge in educational systems worldwide, leading to substantial social and economic costs. Predicting students at risk of dropout allows for timely interventions. While traditional Machine Learning (ML) models operating on tabular data have shown promise, Graph Neural Networks (GNNs) offer a potential advantage by capturing complex relationships inherent in student data if structured as graphs. This paper investigates whether transforming tabular student data into graph structures, primarily using clustering techniques, enhances dropout prediction accuracy. We compare the performance of GNNs (a custom Graph Convolutional Network (GCN) and GraphSAGE) on these generated graphs against established tabular models (Random Forest (RF), XGBoost, and TabNet) using a real-world student dataset. Our experiments explore various graph construction strategies based on different clustering algorithms (K-Means, HDBSCAN) and dimensionality reduction techniques (Principal Component Analysis (PCA), Uniform Manifold Approximation and Projection (UMAP)). Our findings demonstrate that a specific GNN configuration, GraphSAGE on a graph derived from PCA-KMeans clustering, achieved superior performance, notably improving the macro F1-score by approximately 7 percentage points and accuracy by nearly 2 percentage points over the strongest tabular baseline (XGBoost). However, other GNN configurations and graph construction methods did not consistently surpass tabular models, emphasizing the critical role of the graph generation strategy and GNN architecture selection. This highlights both the potential of GNNs and the challenges in optimally transforming tabular data for graph-based learning in this domain.
Code (0)
등록된 구현이 없습니다.
Tasks
Dimensionality ReductionGraph GenerationSimilar Papers 제목 키워드 기반
SentiDrop: A Multi Modal Machine Learning model for Predicting Dropout in Distance Learning
School dropout is a serious problem in distance learning, where early detection is crucial for effective intervention and student perseverance. Predicting student dropout using available educational data is a widely rese…
Feature ImportanceSentiment AnalysisStudent dropoutPredicting student's dropout in university classes using two-layer ensemble machine learning approach: A novel stacked generalization
Student dropout is a serious problem globally. It affects not only the individual who drops out but also the former school, family, and society in general. With the current development of science and technology, big data…
Ensemble LearningStudent dropoutA Systematic Evaluation Protocol of Graph-Derived Signals for Tabular Machine Learning
While graph-derived signals are widely used in tabular learning, existing studies typically rely on limited experimental setups and average performance comparisons, leaving the statistical reliability and robustness of o…
Hyperparameter OptimizationFraud DetectionPerturbation of Deep Autoencoder Weights for Model Compression and Classification of Tabular Data
Fully connected deep neural networks (DNN) often include redundant weights leading to overfitting and high memory requirements. Additionally, the performance of DNN is often challenged by traditional machine learning mod…
BIG-bench Machine LearningClassificationL2 RegularizationModel CompressionPredicting Louisiana Public High School Dropout through Imbalanced Learning Techniques
This study is motivated by the magnitude of the problem of Louisiana high school dropout and its negative impacts on individual and public well-being. Our goal is to predict students who are at risk of high school dropou…
Vocal Bursts Intensity Prediction