paper-with-me

홈 › Papers

MisgenderMender: A Community-Informed Approach to Interventions for Misgendering

2024-04-23 · Tamanna Hossain, Sunipa Dev, Sameer Singh

Content Warning: This paper contains examples of misgendering and erasure that could be offensive and potentially triggering. Misgendering, the act of incorrectly addressing someone's gender, inflicts serious harm and is pervasive in everyday technologies, yet there is a notable lack of research to combat it. We are the first to address this lack of research into interventions for misgendering by conducting a survey of gender-diverse individuals in the US to understand perspectives about automated interventions for text-based misgendering. Based on survey insights on the prevalence of misgendering, desired solutions, and associated concerns, we introduce a misgendering interventions task and evaluation dataset, MisgenderMender. We define the task with two sub-tasks: (i) detecting misgendering, followed by (ii) correcting misgendering where misgendering is present in domains where editing is appropriate. MisgenderMender comprises 3790 instances of social media content and LLM-generations about non-cisgender public figures, annotated for the presence of misgendering, with additional annotations for correcting misgendering in LLM-generated text. Using this dataset, we set initial benchmarks by evaluating existing NLP systems and highlighting challenges for future models to address. We release the full dataset, code, and demo at https://tamannahossainkay.github.io/misgendermender/.

📄 PDF Abstract BibTeX arXiv:2404.14695

Code (0)

등록된 구현이 없습니다.

Tasks

Survey

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Participatory Research as a Path to Community-Informed, Gender-Fair Machine Translation

2023-06-15 · Dagmar Gromann, Manuel Lardelli, Katta Spiel, Sabrina Burtscher 외

Recent years have seen a strongly increased visibility of non-binary people in public discourse. Accordingly, considerations of gender-fair language go beyond a binary conception of male/female. However, language technol…

Machine Translation

A Multilingual, Culture-First Approach to Addressing Misgendering in LLM Applications

2025-03-26 · Sunayana Sitaram, Adrian de Wynter, Isobel McCrum, Qilong Gu 외

Misgendering is the act of referring to someone by a gender that does not match their chosen identity. It marginalizes and undermines a person's sense of self, causing significant harm. English-based approaches have clea…

Language ModelingLanguage ModellingLarge Language Model

Agree to Disagree? A Meta-Evaluation of LLM Misgendering

2025-04-23 · Arjun Subramonian, Vagrant Gautam, Preethi Seshadri, Dietrich Klakow 외

Numerous methods have been proposed to measure LLM misgendering, including probability-based evaluations (e.g., automatically with templatic sentences) and generation-based evaluations (e.g., with automatic heuristics or…

"I'm fully who I am": Towards Centering Transgender and Non-Binary Voices to Measure Biases in Open Language Generation

2023-05-17 · Anaelia Ovalle, Palash Goyal, Jwala Dhamala, Zachary Jaggers 외

Transgender and non-binary (TGNB) individuals disproportionately experience discrimination and exclusion from daily life. Given the recent popularity and adoption of language generation technologies, the potential to fur…

FairnessText Generation

Tokenization Matters: Navigating Data-Scarce Tokenization for Gender Inclusive Language Technologies

2023-12-19 · Anaelia Ovalle, Ninareh Mehrabi, Palash Goyal, Jwala Dhamala 외

Gender-inclusive NLP research has documented the harmful limitations of gender binary-centric large language models (LLM), such as the inability to correctly use gender-diverse English neopronouns (e.g., xe, zir, fae). W…