paper-with-me

홈 › Papers

Anchoring Bias in Large Language Models: An Experimental Study

2024-12-09 · Jiaxu Lou, Yifan Sun

Large Language Models (LLMs) like GPT-4 and Gemini have significantly advanced artificial intelligence by enabling machines to generate and comprehend human-like text. Despite their impressive capabilities, LLMs are not immune to limitations, including various biases. While much research has explored demographic biases, the cognitive biases in LLMs have not been equally scrutinized. This study delves into anchoring bias, a cognitive bias where initial information disproportionately influences judgment. Utilizing an experimental dataset, we examine how anchoring bias manifests in LLMs and verify the effectiveness of various mitigation strategies. Our findings highlight the sensitivity of LLM responses to biased hints. At the same time, our experiments show that, to mitigate anchoring bias, one needs to collect hints from comprehensive angles to prevent the LLMs from being anchored to individual pieces of information, while simple algorithms such as Chain-of-Thought, Thoughts of Principles, Ignoring Anchor Hints, and Reflection are not sufficient.

📄 PDF Abstract BibTeX arXiv:2412.06593

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Adam 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Position-Wise Feed-Forward Layer 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Similar Papers 제목 키워드 기반

How Does Cognitive Bias Affect Large Language Models? A Case Study on the Anchoring Effect in Price Negotiation Simulations

2025-08-28 · Yoshiki Takenami, Yin Jou Huang, Yugo Murawaki, Chenhui Chu arxiv

Cognitive biases, well-studied in humans, can also be observed in LLMs, affecting their reliability in real-world applications. This paper investigates the anchoring effect in LLM-driven price negotiations. To this end, …

An Empirical Study of the Anchoring Effect in LLMs: Existence, Mechanism, and Potential Mitigations

2025-05-21 · Yiming Huang, Biquan Bie, Zuqiu Na, Weilin Ruan 외

The rise of Large Language Models (LLMs) like ChatGPT has advanced natural language processing, yet concerns about cognitive biases are growing. In this paper, we investigate the anchoring effect, a cognitive bias where …

Anchors in the Machine: Behavioral and Attributional Evidence of Anchoring Bias in LLMs

2025-11-07 · Felipe Valencia-Clavijo arxiv

Large language models (LLMs) are increasingly examined as both behavioral subjects and decision systems, yet it remains unclear whether observed cognitive biases reflect surface imitation or deeper probability shifts. An…

Studying the Effects of Cognitive Biases in Evaluation of Conversational Agents

2020-02-18 · Sashank Santhanam, Alireza Karduni, Samira Shaikh

Humans quite frequently interact with conversational agents. The rapid advancement in generative language modeling through neural networks has helped advance the creation of intelligent conversational agents. Researchers…

Decision MakingLanguage ModelingLanguage Modelling

Bias by Necessity: Impossibility Theorems for Sequential Processing with Convergent AI and Human Validation

2026-05-09 · Jikun Wu, Dongxin Guo, Siu-Ming Yiu arxiv

Are certain cognitive biases mathematically inevitable consequences of sequential information processing? We prove that primacy effects, anchoring, and order-dependence are architecturally necessary in autoregressive lan…