Optimizing Statistical Machine Translation for Text Simplification
Most recent sentence simplification systems use basic machine translation models to learn lexical and syntactic paraphrases from a manually simplified parallel corpus. These methods are limited by the quality and quantity of manually simplified corpora, which are expensive to build. In this paper, we conduct an in-depth adaptation of statistical machine translation to perform text simplification, taking advantage of large-scale paraphrases learned from bilingual texts and a small amount of manual simplifications with multiple references. Our work is the first to design automatic metrics that are effective for tuning and evaluating simplification systems, which will facilitate iterative development for this task.
Code (1)
Tasks
Machine TranslationSentenceText SimplificationTranslationSimilar Papers 제목 키워드 기반
Building a Monolingual Parallel Corpus for Text Simplification Using Sentence Similarity Based on Alignment between Word Embeddings
Methods for text simplification using the framework of statistical machine translation have been extensively studied in recent years. However, building the monolingual parallel corpus necessary for training the model req…
Machine TranslationSentenceSentence SimilarityText Simplification+2Sentence Alignment Methods for Improving Text Simplification Systems
We provide several methods for sentence-alignment of texts with different complexity levels. Using the best of them, we sentence-align the Newsela corpora, thus providing large training materials for automatic text simpl…
Lexical SimplificationMachine TranslationSentenceText Simplification+2Improving Neural Text Simplification Model with Simplified Corpora
Text simplification (TS) can be viewed as monolingual translation task, translating between text variations within a single language. Recent neural TS models draw on insights from neural machine translation to learn lexi…
DecoderLexical SimplificationMachine Translationmodel+3Simplifying the Bible and Wikipedia Using Statistical Machine Translation
I started this work with the hope of generating a text synthesizer (like a musical synthesizer) that can imitate certain linguistic styles. Most of the report focuses on text simplification using statistical machine tran…
ArticlesLanguage ModelingLanguage ModellingMachine Translation+2Morphology Generation for Statistical Machine Translation using Deep Learning Techniques
Morphology in unbalanced languages remains a big challenge in the context of machine translation. In this paper, we propose to de-couple machine translation from morphology generation in order to better deal with the pro…
ClassificationDeep LearningGender ClassificationGeneral Classification+2