paper-with-me

홈 › Papers

The Devil is in the Data: Learning Fair Graph Neural Networks via Partial Knowledge Distillation

2023-11-29 · Yuchang Zhu, Jintang Li, Liang Chen, Zibin Zheng

Graph neural networks (GNNs) are being increasingly used in many high-stakes tasks, and as a result, there is growing attention on their fairness recently. GNNs have been shown to be unfair as they tend to make discriminatory decisions toward certain demographic groups, divided by sensitive attributes such as gender and race. While recent works have been devoted to improving their fairness performance, they often require accessible demographic information. This greatly limits their applicability in real-world scenarios due to legal restrictions. To address this problem, we present a demographic-agnostic method to learn fair GNNs via knowledge distillation, namely FairGKD. Our work is motivated by the empirical observation that training GNNs on partial data (i.e., only node attributes or topology data) can improve their fairness, albeit at the cost of utility. To make a balanced trade-off between fairness and utility performance, we employ a set of fairness experts (i.e., GNNs trained on different partial data) to construct the synthetic teacher, which distills fairer and informative knowledge to guide the learning of the GNN student. Experiments on several benchmark datasets demonstrate that FairGKD, which does not require access to demographic information, significantly improves the fairness of GNNs by a large margin while maintaining their utility.

📄 PDF Abstract BibTeX arXiv:2311.17373

Code (1)

zzoomd/fairgkd 공식 구현 pytorch

Tasks

FairnessKnowledge Distillation

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Interventional Fairness on Partially Known Causal Graphs: A Constrained Optimization Approach

2024-01-19 · Aoqi Zuo, Yiqing Li, Susan Wei, Mingming Gong

Fair machine learning aims to prevent discrimination against individuals or sub-populations based on sensitive attributes such as gender and race. In recent years, causal inference methods have been increasingly used in …

Causal InferenceFairness

Counterfactual Fairness with Partially Known Causal Graph

2022-05-27 · Aoqi Zuo, Susan Wei, Tongliang Liu, Bo Han 외

Fair machine learning aims to avoid treating individuals or sub-populations unfavourably based on \textit{sensitive attributes}, such as gender and race. Those methods in fair machine learning that are built on causal in…

BIG-bench Machine LearningCausal InferencecounterfactualFairness

Toward Fair Graph Neural Networks Via Dual-Teacher Knowledge Distillation

2024-11-30 · Chengyu Li, Debo Cheng, Guixian Zhang, Yi Li 외

Graph Neural Networks (GNNs) have demonstrated strong performance in graph representation learning across various real-world applications. However, they often produce biased predictions caused by sensitive attributes, su…

FairnessGraph Representation LearningKnowledge DistillationRepresentation Learning

Unlocking Fairness: a Trade-off Revisited

2019-12-01 · NeurIPS 2019 12 · Michael Wick, Swetasudha Panda, Jean-Baptiste Tristan

The prevailing wisdom is that a model's fairness and its accuracy are in tension with one another. However, there is a pernicious {\em modeling-evaluating dualism} bedeviling fair machine learning in which phenome…

FairnessSelection bias

Fairness under Graph Uncertainty: Achieving Interventional Fairness with Partially Known Causal Graphs over Clusters of Variables

2026-02-27 · Yoichi Chikahara arxiv

Algorithmic decisions about individuals require predictions that are not only accurate but also fair with respect to sensitive attributes such as gender and race. Causal notions of fairness align with legal requirements,…