EASSE-DE: Easier Automatic Sentence Simplification Evaluation for German
In this work, we propose EASSE-multi, a framework for easier automatic sentence evaluation for languages other than English. Compared to the original EASSE framework, EASSE-multi does not focus only on English. It contains tokenizers and versions of text simplification evaluation metrics which are suitable for multiple languages. In this paper, we exemplify the usage of EASSE-multi for German TS, resulting in EASSE-DE. Further, we compare text simplification results when evaluating with different language or tokenization settings of the metrics. Based on this, we formulate recommendations on how to make the evaluation of (German) TS models more transparent and better comparable. The code of EASSE-multi and its German specialisation (EASSE-DE) can be found at https://github.com/rstodden/easse-de.
Code (1)
Tasks
SentenceText SimplificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
EASSE: Easier Automatic Sentence Simplification Evaluation
We introduce EASSE, a Python package aiming to facilitate and standardise automatic evaluation and comparison of Sentence Simplification (SS) systems. EASSE provides a single access point to a broad range of evaluation r…
SentenceSentence Simplification with Memory-Augmented Neural Networks
Sentence simplification aims to simplify the content and structure of complex sentences, and thus make them easier to interpret for human readers, and easier to process for downstream NLP applications. Recent advances in…
Machine TranslationSentenceText SimplificationTranslationAn In-depth Evaluation of GPT-4 in Sentence Simplification with Error-based Human Assessment
Sentence simplification, which rewrites a sentence to be easier to read and understand, is a promising technique to help people with various reading difficulties. With the rise of advanced large language models (LLMs), e…
SentenceCoreference-Based Text Simplification
Text simplification aims at adapting documents to make them easier to read by a given audience. Usually, simplification systems consider only lexical and syntactic levels, and, moreover, are often evaluated at the senten…
coreference-resolutionCoreference ResolutionSentenceText SimplificationPolicy-based Sentence Simplification: Replacing Parallel Corpora with LLM-as-a-Judge
Sentence simplification aims to modify a sentence to make it easier to read and understand while preserving the meaning. Different applications require distinct simplification policies, such as replacing only complex wor…