A Nontrivial Sentence Corpus for the Task of Sentence Readability Assessment in Portuguese
Effective textual communication depends on readers being proficient enough to comprehend texts, and texts being clear enough to be understood by the intended audience, in a reading task. When the meaning of textual information and instructions is not well conveyed, many losses and damages may occur. Among the solutions to alleviate this problem is the automatic evaluation of sentence readability, task which has been receiving a lot of attention due to its large applicability. However, a shortage of resources, such as corpora for training and evaluation, hinders the full development of this task. In this paper, we generate a nontrivial sentence corpus in Portuguese. We evaluate three scenarios for building it, taking advantage of a parallel corpus of simplification, in which each sentence triplet is aligned and has simplification operations annotated, being ideal for justifying possible mistakes of future methods. The best scenario of our corpus PorSimplesSent is composed of 4,888 pairs, which is bigger than a similar corpus for English; all the three versions of it are publicly available. We created four baselines for PorSimplesSent and made available a pairwise ranking method, using 17 linguistic and psycholinguistic features, which correctly identifies the ranking of sentence pairs with an accuracy of 74.2{\%}.
Code (0)
등록된 구현이 없습니다.
Tasks
SentenceTripletSimilar Papers 제목 키워드 기반
Developing a Monolingual Sentence Simplification Corpus for Urdu
Complex sentences are a hurdle in the learning process of language learners. Sentence simplification aims to convert a complex sentence into its simpler form such that it is easily comprehensible. To build such automated…
SentenceText SimplificationReadability-based Sentence Ranking for Evaluating Text Simplification
We propose a new method for evaluating the readability of simplified sentences through pair-wise ranking. The validity of the method is established through in-corpus and cross-corpus evaluation experiments. The approach …
ArticlesCross-corpusSentenceText SimplificationGuidelines for Fine-grained Sentence-level Arabic Readability Annotation
This paper presents the foundational framework and initial findings of the Balanced Arabic Readability Evaluation Corpus (BAREC) project, designed to address the need for comprehensive Arabic language resources aligned w…
BenchmarkingSentenceA Corpus for Automatic Readability Assessment and Text Simplification of German
In this paper, we present a corpus for use in automatic readability assessment and automatic text simplification of German. The corpus is compiled from web sources and consists of approximately 211,000 sentences. As a no…
BIG-bench Machine LearningText SimplificationAssessing sentence readability for German language learners with broad linguistic modeling or readability formulas: When do linguistic insights make a difference?
We present a new state-of-the-art sentence-wise readability assessment model for German L2 readers. We build a linguistically broadly informed machine learning model and compare its performance against four commonly used…
Sentence