paper-with-me

Papers

Toward Human-Centered Readability Evaluation

2025-10-12 · Bahar İlgen, Georges Hattab arxiv

Text simplification is essential for making public health information accessible to diverse populations, including those with limited health literacy. However, commonly used evaluation metrics in Natural Language Processing (NLP), such as BLEU, FKGL, and SARI, mainly capture surface-level features and fail to account for human-centered qualities like clarity, trustworthiness, tone, cultural relevance, and actionability. This limitation is particularly critical in high-stakes health contexts, where communication must be not only simple but also usable, respectful, and trustworthy. To address this gap, we propose the Human-Centered Readability Score (HCRS), a five-dimensional evaluation framework grounded in Human-Computer Interaction (HCI) and health communication research. HCRS integrates automatic measures with structured human feedback to capture the relational and contextual aspects of readability. We outline the framework, discuss its integration into participatory evaluation workflows, and present a protocol for empirical validation. This work aims to advance the evaluation of health text simplification beyond surface metrics, enabling NLP systems that align more closely with diverse users' needs, expectations, and lived experiences.

📄 PDF Abstract BibTeX arXiv:2510.10801

Code (0)

등록된 구현이 없습니다.

Tasks

Text Simplification

Similar Papers 제목 키워드 기반

Iterative Prompt Refinement for Dyslexia-Friendly Text Summarization Using GPT-4o

2026-02-26 · Samay Bhojwani, Swarnima Kain, Lisong Xu arxiv

Dyslexia affects approximately 10% of the global population and presents persistent challenges in reading fluency and text comprehension. While existing assistive technologies address visual presentation, linguistic comp…

Text Summarization

Readability Measures and Automatic Text Simplification: In the Search of a Construct

2025-11-12 · Rémi Cardon, A. Seza Doğruöz arxiv

Readability is a key concept in the current era of abundant written information. To help making texts more readable and make information more accessible to everyone, a line of researched aims at making texts accessible f…

Text Simplification

Evaluating the Evaluators: Are readability metrics good measures of readability?

2025-08-26 · Isabel Cachola, Daniel Khashabi, Mark Dredze arxiv

Plain Language Summarization (PLS) aims to distill complex documents into accessible summaries for non-expert audiences. In this paper, we conduct a thorough survey of PLS literature, and identify that the current standa…

TRScore: A Novel GPT-based Readability Scorer for ASR Segmentation and Punctuation model evaluation and selection

2022-10-27 · Piyush Behre, Sharman Tan, Amy Shah, Harini Kesavamoorthy 외

Punctuation and Segmentation are key to readability in Automatic Speech Recognition (ASR), often evaluated using F1 scores that require high-quality human transcripts and do not reflect readability well. Human evaluation…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Model SelectionSegmentation+3

A User-Centered Evaluation of Spanish Text Simplification

2023-08-15 · Adrian de Wynter, Anthony Hevia, Si-Qing Chen

We present an evaluation of text simplification (TS) in Spanish for a production system, by means of two corpora focused in both complex-sentence and complex-word identification. We compare the most prevalent Spanish-spe…

Complex Word IdentificationSentenceText Simplification