Fair is Better than Sensational:Man is to Doctor as Woman is to Doctor
Analogies such as "man is to king as woman is to X" are often used to illustrate the amazing power of word embeddings. Concurrently, they have also been used to expose how strongly human biases are encoded in vector spaces built on natural language, like "man is to computer programmer as woman is to homemaker". Recent work has shown that analogies are in fact not such a diagnostic for bias, and other methods have been proven to be more apt to the task. However, beside the intrinsic problems with the analogy task as a bias detection tool, in this paper we show that a series of issues related to how analogies have been implemented and used might have yielded a distorted picture of bias in word embeddings. Human biases are present in word embeddings and need to be addressed. Analogies, though, are probably not the right tool to do so. Also, the way they have been most often used has exacerbated some possibly non-existing biases and perhaps hid others. Because they are still widely popular, and some of them have become classics within and outside the NLP community, we deem it important to provide a series of clarifications that should put well-known, and potentially new cases into the right perspective.
Code (1)
Tasks
Bias DetectionDiagnosticWord EmbeddingsSimilar Papers 제목 키워드 기반
Fair Is Better than Sensational: Man Is to Doctor as Woman Is to Doctor
Analogies such as man is to king as woman is to X are often used to illustrate the amazing power of word embeddings. Concurrently, they have also been used to expose how strongly human biases are encoded in vector spaces…
Bias DetectionDiagnosticWord EmbeddingsClickbait? Sensational Headline Generation with Auto-tuned Reinforcement Learning
Sensational headlines are headlines that capture people's attention and generate reader interest. Conventional abstractive headline generation methods, unlike human writers, do not optimize for maximal reader attention. …
Headline Generationreinforcement-learningReinforcement LearningReinforcement Learning (RL)ChatGPT Perpetuates Gender Bias in Machine Translation and Ignores Non-Gendered Pronouns: Findings across Bengali and Five other Low-Resource Languages
In this multicultural age, language translation is one of the most performed tasks, and it is becoming increasingly AI-moderated and automated. As a novel AI system, ChatGPT claims to be proficient in such translation ta…
Machine TranslationTranslationSens-VisualNews: A Benchmark Dataset for Sensational Image Detection
The detection of sensational content in media items can be a critical filtering mechanism for identifying check-worthy content and flagging potential disinformation, since such content triggers physiological arousal that…
The PAT model of population dynamics
We introduce a population-age-time (PAT) model which describes the temporal evolution of the population distribution in age. The surprising result is that the qualitative nature of the population distribution dynamics is…
model