paper-with-me

CrowS-Pairs

홈페이지 · 논문 147편

CrowS-Pairs has 1508 examples that cover stereotypes dealing with nine types of bias, like race, religion, and age. In CrowS-Pairs a model is presented with two sentences: one that is more stereotyping and another that is less stereotyping. The data focuses on stereotypes about historically disadvantaged groups and contrasts them with advantaged groups. Source: [CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Models](/paper/crows-pairs-a-challenge-dataset-for-measuring)

벤치마크

Stereotypical Bias Analysis on CrowS-Pairs 결과 4개