Counterfactual Multi-Token Fairness in Text Classification
The counterfactual token generation has been limited to perturbing only a single token in texts that are generally short and single sentences. These tokens are often associated with one of many sensitive attributes. With limited counterfactuals generated, the goal to achieve invariant nature for machine learning classification models towards any sensitive attribute gets bounded, and the formulation of Counterfactual Fairness gets narrowed. In this paper, we overcome these limitations by solving root problems and opening bigger domains for understanding. We have curated a resource of sensitive tokens and their corresponding perturbation tokens, even extending the support beyond traditionally used sensitive attributes like Age, Gender, Race to Nationality, Disability, and Religion. The concept of Counterfactual Generation has been extended to multi-token support valid over all forms of texts and documents. We define the method of generating counterfactuals by perturbing multiple sensitive tokens as Counterfactual Multi-token Generation. The method has been conceptualized to showcase significant performance improvement over single-token methods and validated over multiple benchmark datasets. The emendation in counterfactual generation propagates in achieving improved Counterfactual Multi-token Fairness.
Code (0)
등록된 구현이 없습니다.
Tasks
AttributeClassificationcounterfactualFairnesstext-classificationText ClassificationvalidMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Counterfactual Fairness in Text Classification through Robustness
In this paper, we study counterfactual fairness in text classification, which asks the question: How would the prediction change if the sensitive attribute referenced in the example were different? Toxicity classifiers d…
AttributeClassificationcounterfactualFairness+3Fairness for Text Classification Tasks with Identity Information Data Augmentation Methods
Counterfactual fairness methods address the question: How would the prediction change if the sensitive identity attributes referenced in the text instance were different? These methods are entirely based on generating co…
counterfactualData AugmentationFairnesstext-classification+2Towards Fairness Assessment of Dutch Hate Speech Detection
Numerous studies have proposed computational methods to detect hate speech online, yet most focus on the English language and emphasize model development. In this study, we evaluate the counterfactual fairness of hate sp…
counterfactualFairnessHate Speech DetectionSentenceFair Hate Speech Detection through Evaluation of Social Group Counterfactuals
Approaches for mitigating bias in supervised models are designed to reduce models' dependence on specific sensitive features of the input data, e.g., mentioned social groups. However, in the case of hate speech detection…
counterfactualFairnessHate Speech DetectionSentenceImproving Counterfactual Generation for Fair Hate Speech Detection
Bias mitigation approaches reduce models' dependence on sensitive features of data, such as social group tokens (SGTs), resulting in equal predictions across the sensitive features. In hate speech detection, however, equ…
counterfactualFairnessHate Speech DetectionSentence