Recognition of They/Them as Singular Personal Pronouns in Coreference Resolution
As using they/them as personal pronouns becomes increasingly common in English, it is important that coreference resolution systems work as well for individuals who use personal “they” as they do for those who use gendered personal pronouns. We introduce a new benchmark for coreference resolution systems which evaluates singular personal “they” recognition. Using these WinoNB schemas, we evaluate a number of publicly available coreference resolution systems and confirm their bias toward resolving “they” pronouns as plural.
Code (1)
Tasks
coreference-resolutionCoreference ResolutionSimilar Papers 제목 키워드 기반
MISGENDERED: Limits of Large Language Models in Understanding Pronouns
Content Warning: This paper contains examples of misgendering and erasure that could be offensive and potentially triggering. Gender bias in language technologies has been widely studied, but research has mostly been res…
SentenceMachine Translation of Spanish Personal and Possessive Pronouns Using Anaphora Probabilities
We implement a fully probabilistic model to combine the hypotheses of a Spanish anaphora resolution system with those of a Spanish-English machine translation system. The probabilities over antecedents are converted into…
Coreference ResolutionMachine TranslationTranslationDeep Representations of First-person Pronouns for Prediction of Depression Symptom Severity
Prior work has shown that analyzing the use of first-person singular pronouns can provide insight into individuals' mental status, especially depression symptom severity. These findings were generated by counting frequen…
Language ModelingLanguage ModellingDepression Symptoms and Relational Patterns in 187k ChatGPT Histories
Large language models are increasingly used as private, always-available conversational systems, but little is known about how people with depressive symptoms use them. Building on CSCW work on disclosure and peer suppor…
Transforming Dutch: Debiasing Dutch Coreference Resolution Systems for Non-binary Pronouns
Gender-neutral pronouns are increasingly being introduced across Western languages. Recent evaluations have however demonstrated that English NLP systems are unable to correctly process gender-neutral pronouns, with the …
coreference-resolutionCoreference ResolutioncounterfactualData Augmentation