Sentence Alignment Methods for Improving Text Simplification Systems
We provide several methods for sentence-alignment of texts with different complexity levels. Using the best of them, we sentence-align the Newsela corpora, thus providing large training materials for automatic text simplification (ATS) systems. We show that using this dataset, even the standard phrase-based statistical machine translation models for ATS can outperform the state-of-the-art ATS systems.
Code (0)
등록된 구현이 없습니다.
Tasks
Lexical SimplificationMachine TranslationSentenceText SimplificationTranslationWord EmbeddingsSimilar Papers 제목 키워드 기반
DEPLAIN: A German Parallel Corpus with Intralingual Translations into Plain Language for Sentence and Document Simplification
Text simplification is an intralingual translation task in which documents, or sentences of a complex source text are simplified for a target audience. The success of automatic text simplification systems is highly depen…
2kSentenceText SimplificationDSim, a Danish Parallel Corpus for Text Simplification
We present DSim, a new sentence aligned Danish monolingual parallel corpus extracted from 3701 pairs of news telegrams and corresponding professionally simplified short news articles. The corpus is intended for building …
ArticlesMachine TranslationSentenceText Generation+1Neural CRF Model for Sentence Alignment in Text Simplification
The success of a text simplification system heavily depends on the quality and quantity of complex-simple sentence pairs in the training corpus, which are extracted by aligning sentences between parallel articles. To eva…
ArticlesSemantic SimilaritySemantic Textual SimilaritySentence+1Align and Shine: Building High-Quality Sentence-Aligned Corpora for Multilingual Text Simplification
Text simplification plays a crucial role in improving the accessibility and comprehensibility of written information for diverse audiences, including language learners and readers with limited literacy. Despite its impor…
Text SimplificationTS-ANNO: An Annotation Tool to Build, Annotate and Evaluate Text Simplification Corpora
We introduce TS-ANNO, an open-source web application for manual creation and for evaluation of parallel corpora for text simplification. TS-ANNO can be used for i) sentence–wise alignment, ii) rating alignment pairs (e.g…
SentenceText Simplification