paper-with-me

Papers

Fair Class-Incremental Learning using Sample Weighting

2024-10-02 · Jaeyoung Park, Minsu Kim, Steven Euijong Whang

Model fairness is becoming important in class-incremental learning for Trustworthy AI. While accuracy has been a central focus in class-incremental learning, fairness has been relatively understudied. However, naively using all the samples of the current task for training results in unfair catastrophic forgetting for certain sensitive groups including classes. We theoretically analyze that forgetting occurs if the average gradient vector of the current task data is in an "opposite direction" compared to the average gradient vector of a sensitive group, which means their inner products are negative. We then propose a fair class-incremental learning framework that adjusts the training weights of current task samples to change the direction of the average gradient vector and thus reduce the forgetting of underperforming groups and achieve fairness. For various group fairness measures, we formulate optimization problems to minimize the overall losses of sensitive groups while minimizing the disparities among them. We also show the problems can be solved with linear programming and propose an efficient Fairness-aware Sample Weighting (FSW) algorithm. Experiments show that FSW achieves better accuracy-fairness tradeoff results than state-of-the-art approaches on real datasets.

📄 PDF Abstract BibTeX arXiv:2410.01324

Code (0)

등록된 구현이 없습니다.

Tasks

class-incremental learningClass Incremental LearningFairnessIncremental Learning

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Comprehensive Validation on Reweighting Samples for Bias Mitigation via AIF360

2023-12-19 · Christina Hastings Blow, Lijun Qian, Camille Gibson, Pamela Obiomon 외

Fairness AI aims to detect and alleviate bias across the entire AI development life cycle, encompassing data curation, modeling, evaluation, and deployment-a pivotal aspect of ethical AI implementation. Addressing data b…

Binary ClassificationFairness

FORML: Learning to Reweight Data for Fairness

2022-02-03 · Bobby Yan, Skyler Seto, Nicholas Apostoloff

Machine learning models are trained to minimize the mean loss for a single metric, and thus typically do not consider fairness and robustness. Neglecting such metrics in training can make these models prone to fairness v…

Fairnessimage-classificationImage ClassificationMeta-Learning+1

AREA: Adaptive Reweighting via Effective Area for Long-Tailed Classification

2023-01-01 · ICCV 2023 1 · Xiaohua Chen, Yucan Zhou, Dayan Wu, Chule Yang 외

Large-scale data from real-world usually follow a long-tailed distribution (i.e., a few majority classes occupy plentiful training data, while most minority classes have few samples), making the hyperplanes heavily s…

Enhancing Fairness through Reweighting: A Path to Attain the Sufficiency Rule

2024-08-26 · Xuan Zhao, Klaus Broelemann, Salvatore Ruggieri, Gjergji Kasneci

We introduce an innovative approach to enhancing the empirical risk minimization (ERM) process in model training through a refined reweighting scheme of the training data to enhance fairness. This scheme aims to uphold t…

Fairness

Meta-Weight-Net: Learning an Explicit Mapping For Sample Weighting

2019-02-20 · NeurIPS 2019 12 · Jun Shu, Qi Xie, Lixuan Yi, Qian Zhao 외

Current deep neural networks (DNNs) can easily overfit to biased training data with corrupted labels or class imbalance. Sample re-weighting strategy is commonly used to alleviate this issue by designing a weighting func…

Image ClassificationMeta-Learning