paper-with-me

홈 › Papers

Humanlike Cognitive Patterns as Emergent Phenomena in Large Language Models

2024-12-20 · Zhisheng Tang, Mayank Kejriwal

Research on emergent patterns in Large Language Models (LLMs) has gained significant traction in both psychology and artificial intelligence, motivating the need for a comprehensive review that offers a synthesis of this complex landscape. In this article, we systematically review LLMs' capabilities across three important cognitive domains: decision-making biases, reasoning, and creativity. We use empirical studies drawing on established psychological tests and compare LLMs' performance to human benchmarks. On decision-making, our synthesis reveals that while LLMs demonstrate several human-like biases, some biases observed in humans are absent, indicating cognitive patterns that only partially align with human decision-making. On reasoning, advanced LLMs like GPT-4 exhibit deliberative reasoning akin to human System-2 thinking, while smaller models fall short of human-level performance. A distinct dichotomy emerges in creativity: while LLMs excel in language-based creative tasks, such as storytelling, they struggle with divergent thinking tasks that require real-world context. Nonetheless, studies suggest that LLMs hold considerable potential as collaborators, augmenting creativity in human-machine problem-solving settings. Discussing key limitations, we also offer guidance for future research in areas such as memory, attention, and open-source model development.

📄 PDF Abstract BibTeX arXiv:2412.15501

Code (0)

등록된 구현이 없습니다.

Tasks

Decision Making

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Residual Connection 설명 없음
Adam 설명 없음
Multi-Head Attention 설명 없음
Position-Wise Feed-Forward Layer 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

Kernels of Selfhood: GPT-4o shows humanlike patterns of cognitive consistency moderated by free choice

2025-01-27 · Steven A. Lehr, Ketan S. Saichandran, Eddie Harmon-Jones, Nykko Vitali 외

Large Language Models (LLMs) show emergent patterns that mimic human cognition. We explore whether they also mirror other, less deliberative human psychological processes. Drawing upon classical theories of cognitive con…

Response: Emergent analogical reasoning in large language models

2023-08-30 · Damian Hodel, Jevin West

In their recent Nature Human Behaviour paper, "Emergent analogical reasoning in large language models," (Webb, Holyoak, and Lu, 2023) the authors argue that "large language models such as GPT-3 have acquired an emergent …

Memorization

Emergent Communication for Understanding Human Language Evolution: What's Missing?

2022-04-22 · Lukas Galke, Yoav Ram, Limor Raviv

Emergent communication protocols among humans and artificial neural network agents do not yet share the same properties and show some critical mismatches in results. We describe three important phenomena with respect to …

HLB: Benchmarking LLMs' Humanlikeness in Language Use

2024-09-24 · Xufeng Duan, Bei Xiao, Xuemei Tang, Zhenguang G. Cai

As synthetic data becomes increasingly prevalent in training language models, particularly through generated dialogue, concerns have emerged that these models may deviate from authentic human language patterns, potential…

Benchmarking

How language models extrapolate outside the training data: A case study in Textualized Gridworld

2024-06-21 · Doyoung Kim, Jongwon Lee, Jinho Park, Minjoon Seo

Language models' ability to extrapolate learned behaviors to novel, more complex environments beyond their training scope is highly unknown. This study introduces a path planning task in a textualized Gridworld to probe …