paper-with-me

Papers

Conditional Supervised Contrastive Learning for Fair Text Classification

2022-05-23 · Jianfeng Chi, William Shand, Yaodong Yu, Kai-Wei Chang, Han Zhao, Yuan Tian

Contrastive representation learning has gained much attention due to its superior performance in learning representations from both image and sequential data. However, the learned representations could potentially lead to performance disparities in downstream tasks, such as increased silencing of underrepresented groups in toxicity comment classification. In light of this challenge, in this work, we study learning fair representations that satisfy a notion of fairness known as equalized odds for text classification via contrastive learning. Specifically, we first theoretically analyze the connections between learning representations with a fairness constraint and conditional supervised contrastive objectives, and then propose to use conditional supervised contrastive objectives to learn fair representations for text classification. We conduct experiments on two text datasets to demonstrate the effectiveness of our approaches in balancing the trade-offs between task performance and bias mitigation among existing baselines for text classification. Furthermore, we also show that the proposed methods are stable in different hyperparameter settings.

📄 PDF Abstract BibTeX arXiv:2205.11485

Code (1)

jfchi/cscl4ftc 공식 구현 pytorch

Tasks

ClassificationContrastive LearningFairnessRepresentation Learningtext-classificationText Classification

Similar Papers 제목 키워드 기반

Conditional Contrastive Learning for Improving Fairness in Self-Supervised Learning

2021-06-05 · Martin Q. Ma, Yao-Hung Hubert Tsai, Paul Pu Liang, Han Zhao 외

Contrastive self-supervised learning (SSL) learns an embedding space that maps similar data pairs closer and dissimilar data pairs farther apart. Despite its success, one issue has been overlooked: the fairness aspect of…

AttributeContrastive LearningFairnessRepresentation Learning+1

Conditional Contrastive Learning with Kernel

2022-02-11 · ICLR 2022 4 · Yao-Hung Hubert Tsai, Tianqin Li, Martin Q. Ma, Han Zhao 외

Conditional contrastive learning frameworks consider the conditional sampling procedure that constructs positive or negative data pairs conditioned on specific variables. Fair contrastive learning constructs negative pai…

Contrastive Learning

Fair Contrastive Learning for Facial Attribute Classification

2022-03-30 · CVPR 2022 1 · Sungho Park, Jewook Lee, Pilhyeon Lee, Sunhee Hwang 외

Learning visual representation of high quality is essential for image classification. Recently, a series of contrastive representation learning methods have achieved preeminent success. Particularly, SupCon outperformed …

AttributeClassificationContrastive LearningFacial Attribute Classification+5

Provable Optimization for Adversarial Fair Self-supervised Contrastive Learning

2024-06-09 · Qi Qi, Quanqi Hu, Qihang Lin, Tianbao Yang

This paper studies learning fair encoders in a self-supervised learning (SSL) setting, in which all data are unlabeled and only a small portion of them are annotated with sensitive attribute. Adversarial fair representat…

AttributeContrastive LearningFairnessRepresentation Learning+1

Fairness-Aware Node Representation Learning

2021-06-09 · Öykü Deniz Köse, Yanning Shen

Node representation learning has demonstrated its effectiveness for various applications on graphs. Particularly, recent developments in contrastive learning have led to promising results in unsupervised node representat…

Contrastive LearningFairnessNode ClassificationRepresentation Learning