paper-with-me

Papers

Can Large Language Models Predict Associations Among Human Attitudes?

2025-03-26 · Ana Ma, Derek Powell

Prior work has shown that large language models (LLMs) can predict human attitudes based on other attitudes, but this work has largely focused on predictions from highly similar and interrelated attitudes. In contrast, human attitudes are often strongly associated even across disparate and dissimilar topics. Using a novel dataset of human responses toward diverse attitude statements, we found that a frontier language model (GPT-4o) was able to recreate the pairwise correlations among individual attitudes and to predict individuals' attitudes from one another. Crucially, in an advance over prior work, we tested GPT-4o's ability to predict in the absence of surface-similarity between attitudes, finding that while surface similarity improves prediction accuracy, the model was still highly-capable of generating meaningful social inferences between dissimilar attitudes. Altogether, our findings indicate that LLMs capture crucial aspects of the deeper, latent structure of human belief systems.

📄 PDF Abstract BibTeX arXiv:2503.21011

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage Modelling

Similar Papers 제목 키워드 기반

The truth is no diaper: Human and AI-generated associations to emotional words

2025-11-06 · Špela Vintar, Jan Jona Javoršek arxiv

Human word associations are a well-known method of gaining insight into the internal mental lexicon, but the responses spontaneously offered by human participants to word cues are not always predictable as they may be in…

Heterogeneous Causal Metapath Graph Neural Network for Gene-Microbe-Disease Association Prediction

2024-06-27 · Kexin Zhang, Feng Huang, Luotao Liu, Zhankun Xiong 외

The recent focus on microbes in human medicine highlights their potential role in the genetic framework of diseases. To decode the complex interactions among genes, microbes, and diseases, computational predictions of ge…

Graph Neural NetworkRepresentation Learning

Probing Neural Language Models for Human Tacit Assumptions

2020-04-10 · Nathaniel Weir, Adam Poliak, Benjamin Van Durme

Humans carry stereotypic tacit assumptions (STAs) (Prince, 1978), or propositional beliefs about generic concepts. Such associations are crucial for understanding natural language. We construct a diagnostic set of word p…

Diagnostic

A Graph-Based Approach for Computing Free Word Associations

2014-05-01 · LREC 2014 5 · Gemma Bel Enguix, Reinhard Rapp, Michael Zock

A graph-based algorithm is used to analyze the co-occurrences of words in the British National Corpus. It is shown that the statistical regularities detected can be exploited to predict human word associations. The corpu…

Language Acquisition

Frequency Explains the Inverse Correlation of Large Language Models' Size, Training Data Amount, and Surprisal's Fit to Reading Times

2024-02-03 · Byung-Doh Oh, Shisen Yue, William Schuler

Recent studies have shown that as Transformer-based language models become larger and are trained on very large amounts of data, the fit of their surprisal estimates to naturalistic human reading times degrades. The curr…

Language Modelling