Fair Class-Incremental Learning using Sample Weighting
Model fairness is becoming important in class-incremental learning for Trustworthy AI. While accuracy has been a central focus in class-incremental learning, fairness has been relatively understudied. However, naively using all the samples of the current task for training results in unfair catastrophic forgetting for certain sensitive groups including classes. We theoretically analyze that forgetting occurs if the average gradient vector of the current task data is in an "opposite direction" compared to the average gradient vector of a sensitive group, which means their inner products are negative. We then propose a fair class-incremental learning framework that adjusts the training weights of current task samples to change the direction of the average gradient vector and thus reduce the forgetting of underperforming groups and achieve fairness. For various group fairness measures, we formulate optimization problems to minimize the overall losses of sensitive groups while minimizing the disparities among them. We also show the problems can be solved with linear programming and propose an efficient Fairness-aware Sample Weighting (FSW) algorithm. Experiments show that FSW achieves better accuracy-fairness tradeoff results than state-of-the-art approaches on real datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
class-incremental learningClass Incremental LearningFairnessIncremental LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Comprehensive Validation on Reweighting Samples for Bias Mitigation via AIF360
Fairness AI aims to detect and alleviate bias across the entire AI development life cycle, encompassing data curation, modeling, evaluation, and deployment-a pivotal aspect of ethical AI implementation. Addressing data b…
Binary ClassificationFairnessFORML: Learning to Reweight Data for Fairness
Machine learning models are trained to minimize the mean loss for a single metric, and thus typically do not consider fairness and robustness. Neglecting such metrics in training can make these models prone to fairness v…
Fairnessimage-classificationImage ClassificationMeta-Learning+1AREA: Adaptive Reweighting via Effective Area for Long-Tailed Classification
Large-scale data from real-world usually follow a long-tailed distribution (i.e., a few majority classes occupy plentiful training data, while most minority classes have few samples), making the hyperplanes heavily s…
Enhancing Fairness through Reweighting: A Path to Attain the Sufficiency Rule
We introduce an innovative approach to enhancing the empirical risk minimization (ERM) process in model training through a refined reweighting scheme of the training data to enhance fairness. This scheme aims to uphold t…
FairnessMeta-Weight-Net: Learning an Explicit Mapping For Sample Weighting
Current deep neural networks (DNNs) can easily overfit to biased training data with corrupted labels or class imbalance. Sample re-weighting strategy is commonly used to alleviate this issue by designing a weighting func…
Image ClassificationMeta-Learning