paper-with-me

홈 › Papers

SPAWNing Structural Priming Predictions from a Cognitively Motivated Parser

2024-03-11 · Grusha Prasad, Tal Linzen

Structural priming is a widely used psycholinguistic paradigm to study human sentence representations. In this work we introduce SPAWN, a cognitively motivated parser that can generate quantitative priming predictions from contemporary theories in syntax which assume a lexicalized grammar. By generating and testing priming predictions from competing theoretical accounts, we can infer which assumptions from syntactic theory are useful for characterizing the representations humans build when processing sentences. As a case study, we use SPAWN to generate priming predictions from two theories (Whiz-Deletion and Participial-Phase) which make different assumptions about the structure of English relative clauses. By modulating the reanalysis mechanism that the parser uses and strength of the parser's prior knowledge, we generated nine sets of predictions from each of the two theories. Then, we tested these predictions using a novel web-based comprehension-to-production priming paradigm. We found that while the some of the predictions from the Participial-Phase theory aligned with human behavior, none of the predictions from the the Whiz-Deletion theory did, thus suggesting that the Participial-Phase theory might better characterize human relative clause representations.

📄 PDF Abstract BibTeX arXiv:2403.07202

Code (0)

등록된 구현이 없습니다.

Tasks

Sentence

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

Do Language Models Exhibit Human-like Structural Priming Effects?

2024-06-07 · Jaap Jumelet, Willem Zuidema, Arabella Sinclair

We explore which linguistic factors -- at the sentence and token level -- play an important role in influencing language model predictions, and investigate whether these are reflective of results found in humans and huma…

Language ModelingLanguage ModellingSentence

Structural Persistence in Language Models: Priming as a Window into Abstract Language Representations

2021-09-30 · Arabella Sinclair, Jaap Jumelet, Willem Zuidema, Raquel Fernández

We investigate the extent to which modern, neural language models are susceptible to structural priming, the phenomenon whereby the structure of a sentence makes the same structure more probable in a follow-up sentence. …

Natural Language UnderstandingSentence

Towards Human Cognition: Visual Context Guides Syntactic Priming in Fusion-Encoded Models

2025-02-24 · Bushi Xiao, Michael Bennie, Jayetri Bardhan, Daisy Zhe Wang

We introduced PRISMATIC, the first multimodal structural priming dataset, and proposed a reference-free evaluation metric that assesses priming effects without predefined target sentences. Using this metric, we construct…

Structural Priming Demonstrates Abstract Grammatical Representations in Multilingual Language Models

2023-11-15 · James A. Michaelov, Catherine Arnett, Tyler A. Chang, Benjamin K. Bergen

Abstract grammatical knowledge - of parts of speech and grammatical patterns - is key to the capacity for linguistic generalization in humans. But how abstract is grammatical knowledge in large language models? In the hu…

Sentence

Crosslingual Structural Priming and the Pre-Training Dynamics of Bilingual Language Models

2023-10-11 · Catherine Arnett, Tyler A. Chang, James A. Michaelov, Benjamin K. Bergen

Do multilingual language models share abstract grammatical representations across languages, and if so, when do these develop? Following Sinclair et al. (2022), we use structural priming to test for abstract grammatical …

Language ModelingLanguage Modelling