paper-with-me

Papers

Unveiling Gender Bias in Large Language Models: Using Teacher's Evaluation in Higher Education As an Example

2024-09-15 · Yuanning Huang

This paper investigates gender bias in Large Language Model (LLM)-generated teacher evaluations in higher education setting, focusing on evaluations produced by GPT-4 across six academic subjects. By applying a comprehensive analytical framework that includes Odds Ratio (OR) analysis, Word Embedding Association Test (WEAT), sentiment analysis, and contextual analysis, this paper identified patterns of gender-associated language reflecting societal stereotypes. Specifically, words related to approachability and support were used more frequently for female instructors, while words related to entertainment were predominantly used for male instructors, aligning with the concepts of communal and agentic behaviors. The study also found moderate to strong associations between male salient adjectives and male names, though career and family words did not distinctly capture gender biases. These findings align with prior research on societal norms and stereotypes, reinforcing the notion that LLM-generated text reflects existing biases.

📄 PDF Abstract BibTeX arXiv:2409.09652

Code (1)

yuanninghuang/thesis 공식 구현

Tasks

Language ModelingLanguage ModellingLarge Language ModelSentiment Analysis

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Multi-Head Attention 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

Unveiling Gender Bias in Terms of Profession Across LLMs: Analyzing and Addressing Sociological Implications

2023-07-18 · Vishesh Thakur

Gender bias in artificial intelligence (AI) and natural language processing has garnered significant attention due to its potential impact on societal perceptions and biases. This research paper aims to analyze gender bi…

Data Augmentation

From Descriptive Richness to Bias: Unveiling the Dark Side of Generative Image Caption Enrichment

2024-06-20 · Yusuke Hirota, Ryo Hachiuma, Chao-Han Huck Yang, Yuta Nakashima

Large language models (LLMs) have enhanced the capacity of vision-language models to caption visual text. This generative approach to image caption enrichment further makes textual captions more descriptive, improving al…

DescriptiveHallucination

Mitigating Gender Bias in Distilled Language Models via Counterfactual Role Reversal

2022-03-23 · Findings (ACL) 2022 5 · Umang Gupta, Jwala Dhamala, Varun Kumar, Apurv Verma 외

Language models excel at generating coherent text, and model compression techniques such as knowledge distillation have enabled their use in resource-constrained settings. However, these models can be biased in multiple …

counterfactualFairnessKnowledge DistillationModel Compression+1

Measuring Bias in Contextualized Word Representations

2019-06-18 · WS 2019 8 · Keita Kurita, Nidhi Vyas, Ayush Pareek, Alan W. black 외

Contextual word embeddings such as BERT have achieved state of the art performance in numerous NLP tasks. Since they are optimized to capture the statistical properties of training data, they tend to pick up on and ampli…

Word Embeddings

Justice in Judgment: Unveiling (Hidden) Bias in LLM-assisted Peer Reviews

2025-09-16 · Sai Suresh Macharla Vasu, Ivaxi Sheth, Hui-Po Wang, Ruta Binkyte 외 arxiv

The adoption of large language models (LLMs) is transforming the peer review process, from assisting reviewers in writing detailed evaluations to generating entire reviews automatically. While these capabilities offer ne…