paper-with-me

Papers

Measuring the Impact of (Psycho-)Linguistic and Readability Features and Their Spill Over Effects on the Prediction of Eye Movement Patterns

2022-03-15 · ACL 2022 5 · Daniel Wiechmann, Yu Qiao, Elma Kerz, Justus Mattern

There is a growing interest in the combined use of NLP and machine learning methods to predict gaze patterns during naturalistic reading. While promising results have been obtained through the use of transformer-based language models, little work has been undertaken to relate the performance of such models to general text characteristics. In this paper we report on experiments with two eye-tracking corpora of naturalistic reading and two language models (BERT and GPT-2). In all experiments, we test effects of a broad spectrum of features for predicting human reading behavior that fall into five categories (syntactic complexity, lexical richness, register-based multiword combinations, readability and psycholinguistic word properties). Our experiments show that both the features included and the architecture of the transformer-based language models play a role in predicting multiple eye-tracking measures during naturalistic reading. We also report the results of experiments aimed at determining the relative importance of features from different groups using SP-LIME.

📄 PDF Abstract BibTeX arXiv:2203.08085

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Psycholinguistic Models of Sentence Processing Improve Sentence Readability Ranking

2017-04-01 · EACL 2017 4 · David M. Howcroft, Vera Demberg

While previous research on readability has typically focused on document-level measures, recent work in areas such as natural language generation has pointed out the need of sentence-level readability measures. Much of p…

Information RetrievalSentenceText GenerationText Simplification

Deception Detection for the Russian Language: Lexical and Syntactic Parameters

2017-09-01 · RANLP 2017 9 · Dina Pisarevskaya, Tatiana Litvinova, Olga Litvinova

The field of automated deception detection in written texts is methodologically challenging. Different linguistic levels (lexics, syntax and semantics) are basically used for different types of English texts to reveal if…

Binary text classificationDeception DetectionInformation RetrievalPOS+2

Measuring and Modifying the Readability of English Texts with GPT-4

2024-10-17 · Sean Trott, Pamela D. Rivière

The success of Large Language Models (LLMs) in other domains has raised the question of whether LLMs can reliably assess and manipulate the readability of text. We approach this question empirically. First, using a publi…

PUCP-Metrix: An Open-source and Comprehensive Toolkit for Linguistic Analysis of Spanish Texts

2025-11-21 · Javier Alonso Villegas Luis, Marco Antonio Sobrevilla Cabezudo arxiv

Linguistic features remain essential for interpretability and tasks that involve style, structure, and readability, but existing Spanish tools offer limited coverage. We present PUCP-Metrix, an open-source and comprehens…

Text Detection

Long-form analogies generated by chatGPT lack human-like psycholinguistic properties

2023-06-07 · S. M. Seals, Valerie L. Shalin

Psycholinguistic analyses provide a means of evaluating large language model (LLM) output and making systematic comparisons to human-generated text. These methods can be used to characterize the psycholinguistic properti…

FormLanguage ModelingLanguage ModellingLarge Language Model