paper-with-me

홈 › Papers

FairDD: Fair Dataset Distillation via Synchronized Matching

2024-11-29 · Qihang Zhou, Shenhao Fang, Shibo He, Wenchao Meng, Jiming Chen

Condensing large datasets into smaller synthetic counterparts has demonstrated its promise for image classification. However, previous research has overlooked a crucial concern in image recognition: ensuring that models trained on condensed datasets are unbiased towards protected attributes (PA), such as gender and race. Our investigation reveals that dataset distillation (DD) fails to alleviate the unfairness towards minority groups within original datasets. Moreover, this bias typically worsens in the condensed datasets due to their smaller size. To bridge the research gap, we propose a novel fair dataset distillation (FDD) framework, namely FairDD, which can be seamlessly applied to diverse matching-based DD approaches, requiring no modifications to their original architectures. The key innovation of FairDD lies in synchronously matching synthetic datasets to PA-wise groups of original datasets, rather than indiscriminate alignment to the whole distributions in vanilla DDs, dominated by majority groups. This synchronized matching allows synthetic datasets to avoid collapsing into majority groups and bootstrap their balanced generation to all PA groups. Consequently, FairDD could effectively regularize vanilla DDs to favor biased generation toward minority groups while maintaining the accuracy of target attributes. Theoretical analyses and extensive experimental evaluations demonstrate that FairDD significantly improves fairness compared to vanilla DD methods, without sacrificing classification accuracy. Its consistent superiority across diverse DDs, spanning Distribution and Gradient Matching, establishes it as a versatile FDD approach.

📄 PDF Abstract BibTeX arXiv:2411.19623

Code (0)

등록된 구현이 없습니다.

Tasks

Dataset DistillationFairnessimage-classificationImage Classification

Similar Papers 제목 키워드 기반

FairDD: Enhancing Fairness with domain-incremental learning in dermatological disease diagnosis

2024-12-21 · Yiqin Luo, Tianlong Gu

With the rapid advancement of deep learning technologies, artificial intelligence has become increasingly prevalent in the research and application of dermatological disease diagnosis. However, this data-driven approach …

Contrastive LearningData AugmentationDiagnosticFairness+1

Progressive trajectory matching for medical dataset distillation

2024-03-20 · Zhen Yu, Yang Liu, Qingchao Chen

It is essential but challenging to share medical image datasets due to privacy issues, which prohibit building foundation models and knowledge transfer. In this paper, we propose a novel dataset distillation method to co…

Dataset DistillationDiversityTransfer Learning

Fair Feature Distillation for Visual Recognition

2021-05-27 · CVPR 2021 1 · Sangwon Jung, DongGyu Lee, TaeEon Park, Taesup Moon

Fairness is becoming an increasingly crucial issue for computer vision, especially in the human-related decision systems. However, achieving algorithmic fairness, which makes a model produce indiscriminative outcomes aga…

FairnessKnowledge Distillation

Fair4Free: Generating High-fidelity Fair Synthetic Samples using Data Free Distillation

2024-10-02 · Md Fahim Sikder, Daniel de Leng, Fredrik Heintz

This work presents Fair4Free, a novel generative model to generate synthetic fair data using data-free distillation in the latent space. Fair4Free can work on the situation when the data is private or inaccessible. In ou…

Fairness

Toward Fair Graph Neural Networks Via Dual-Teacher Knowledge Distillation

2024-11-30 · Chengyu Li, Debo Cheng, Guixian Zhang, Yi Li 외

Graph Neural Networks (GNNs) have demonstrated strong performance in graph representation learning across various real-world applications. However, they often produce biased predictions caused by sensitive attributes, su…

FairnessGraph Representation LearningKnowledge DistillationRepresentation Learning