paper-with-me

홈 › Papers

Investigating Implicit Bias in Large Language Models: A Large-Scale Study of Over 50 LLMs

2024-10-13 · Divyanshu Kumar, Umang Jain, Sahil Agarwal, Prashanth Harshangi

Large Language Models (LLMs) are being adopted across a wide range of tasks, including decision-making processes in industries where bias in AI systems is a significant concern. Recent research indicates that LLMs can harbor implicit biases even when they pass explicit bias evaluations. Building upon the frameworks of the LLM Implicit Association Test (IAT) Bias and LLM Decision Bias, this study highlights that newer or larger language models do not automatically exhibit reduced bias; in some cases, they displayed higher bias scores than their predecessors, such as in Meta's Llama series and OpenAI's GPT models. This suggests that increasing model complexity without deliberate bias mitigation strategies can unintentionally amplify existing biases. The variability in bias scores within and across providers underscores the need for standardized evaluation metrics and benchmarks for bias assessment. The lack of consistency indicates that bias mitigation is not yet a universally prioritized goal in model development, which can lead to unfair or discriminatory outcomes. By broadening the detection of implicit bias, this research provides a more comprehensive understanding of the biases present in advanced models and underscores the critical importance of addressing these issues to ensure the development of fair and responsible AI systems.

📄 PDF Abstract BibTeX arXiv:2410.12864

Code (0)

등록된 구현이 없습니다.

Tasks

Decision Making

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Cosine Annealing Cosine Annealing is a type of learning rate schedule that has the effect of starting with a large learning rate that is relatively rapidly decreased to a minimum value before…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Linear Warmup With Cosine Annealing Linear Warmup With Cosine Annealing is a learning rate schedule where we increase the learning rate linearly for $n$ updates and then anneal according to a cosine schedule…
Adam 설명 없음
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Attention 설명 없음
Discriminative Fine-Tuning Discriminative Fine-Tuning is a fine-tuning strategy that is used for ULMFiT type models. Instead of using the same learning rate…

Similar Papers 제목 키워드 기반

Explicit vs. Implicit: Investigating Social Bias in Large Language Models through Self-Reflection

2025-01-04 · Yachao Zhao, Bo wang, Yan Wang

Large Language Models (LLMs) have been shown to exhibit various biases and stereotypes in their generated content. While extensive research has investigated bias in LLMs, prior work has predominantly focused on explicit …

The "LLM World of Words" English free association norms generated by large language models

2024-12-02 · Katherine Abramski, Riccardo Improta, Giulio Rossetti, Massimo Stella

Free associations have been extensively used in cognitive psychology and linguistics for studying how conceptual knowledge is organized. Recently, the potential of applying a similar approach for investigating the knowle…

Implicit Causality-biases in humans and LLMs as a tool for benchmarking LLM discourse capabilities

2025-01-22 · Florian Kankowski, Torgrim Solstad, Sina Zarriess, Oliver Bott

In this paper, we compare data generated with mono- and multilingual LLMs spanning a range of model sizes with data provided by human participants in an experimental setting investigating well-established discourse biase…

BenchmarkingReferring Expression

Invisible Influences: Investigating Implicit Intersectional Biases through Persona Engineering in Large Language Models

2026-03-16 · Nandini Arimanda, Achyuth Mukund, Sakthi Balan Muthiah, Rajesh Sharma arxiv

Large Language Models (LLMs) excel at human-like language generation but often embed and amplify implicit, intersectional biases, especially under persona-driven contexts. Existing bias audits rely on static, embedding-b…

Searching for Structure: Investigating Emergent Communication with Large Language Models

2024-12-10 · Tom Kouwenhoven, Max Peeperkorn, Tessa Verhoef

Human languages have evolved to be structured through repeated language learning and use. These processes introduce biases that operate during language acquisition and shape linguistic systems toward communicative effici…

Language Acquisition