Deconstructing sentence disambiguation by joint latent modeling of reading paradigms: LLM surprisal is not enough
Using temporarily ambiguous garden-path sentences ("While the team trained the striker wondered ...") as a test case, we present a latent-process mixture model of human reading behavior across four different reading paradigms (eye tracking, uni- and bidirectional self-paced reading, Maze). The model distinguishes between garden-path probability, garden-path cost, and reanalysis cost, and yields more realistic processing cost estimates by taking into account trials with inattentive reading. We show that the model is able to reproduce empirical patterns with regard to rereading behavior, comprehension question responses, and grammaticality judgments. Cross-validation reveals that the mixture model also has better predictive fit to human reading patterns and end-of-trial task data than a mixture-free model based on GPT-2-derived surprisal values. We discuss implications for future work.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Explainable and Discourse Topic-aware Neural Language Understanding
Marrying topic models and language models exposes language understanding to a broader source of document-level context beyond sentences via topics. While introducing topical semantics in language models, existing approac…
Document ClassificationLanguage ModelingLanguage ModellingRetrieval+4The Fewer Splits are Better: Deconstructing Readability in Sentence Splitting
In this work, we focus on sentence splitting, a subfield of text simplification, motivated largely by an unproven idea that if you divide a sentence in pieces, it should become easier to understand. Our primary goal in t…
SentenceText SimplificationModeling Semantic Relations Expressed by Prepositions
This paper introduces the problem of predicting semantic relations expressed by prepositions and develops statistical learning models for predicting the relations, their arguments and the semantic types of the arguments.…
Natural Language InferenceQuestion AnsweringRelationRelation Prediction+2Word Sense Disambiguation: A comprehensive knowledge exploitation framework
Word Sense Disambiguation (WSD) has been a basic and on-going issue since its introduction in natural language processing (NLP) community. Its application lies in many different areas including sentiment analysis, Inform…
graph constructionInformation RetrievalMachine TranslationRetrieval+4LATTE: Latent Type Modeling for Biomedical Entity Linking
Entity linking is the task of linking mentions of named entities in natural language text, to entities in a curated knowledge-base. This is of significant importance in the biomedical domain, where it could be used to se…
Entity DisambiguationEntity LinkingVocal Bursts Type Prediction