paper-with-me

Papers

Morphology Generation for Statistical Machine Translation

2017-10-05 · Sreelekha. S, Pushpak Bhattacharyya

When translating into morphologically rich languages, Statistical MT approaches face the problem of data sparsity. The severity of the sparseness problem will be high when the corpus size of morphologically richer language is less. Even though we can use factored models to correctly generate morphological forms of words, the problem of data sparseness limits their performance. In this paper, we describe a simple and effective solution which is based on enriching the input corpora with various morphological forms of words. We use this method with the phrase-based and factor-based experiments on two morphologically rich languages: Hindi and Marathi when translating from English. We evaluate the performance of our experiments both in terms automatic evaluation and subjective evaluation such as adequacy and fluency. We observe that the morphology injection method helps in improving the quality of translation. We further analyze that the morph injection method helps in handling the data sparseness problem to a great level.

📄 PDF Abstract BibTeX arXiv:1710.02093

Code (0)

등록된 구현이 없습니다.

Tasks

Machine TranslationMORPHTranslation

Similar Papers 제목 키워드 기반

Rich Morphology Generation Using Statistical Machine Translation

2012-05-01 · WS 2012 5 · Ahmed El Kholy, Nizar Habash
Language ModellingMachine TranslationText GenerationTranslation

Morphology Generation for Statistical Machine Translation using Deep Learning Techniques

2016-10-07 · Marta R. Costa-jussà, Carlos Escolano

Morphology in unbalanced languages remains a big challenge in the context of machine translation. In this paper, we propose to de-couple machine translation from morphology generation in order to better deal with the pro…

ClassificationDeep LearningGender ClassificationGeneral Classification+2

Understanding and Improving Morphological Learning in the Neural Machine Translation Decoder

2017-11-01 · IJCNLP 2017 11 · Fahim Dalvi, Nadir Durrani, Hassan Sajjad, Yonatan Belinkov 외

End-to-end training makes the neural machine translation (NMT) architecture simpler, yet elegant compared to traditional statistical machine translation (SMT). However, little is known about linguistic patterns of morpho…

DecoderMachine TranslationMulti-Task LearningNMT+1

Morphology Injection for English-Malayalam Statistical Machine Translation

2018-05-01 · LREC 2018 5 · Sreelekha. S, Pushpak Bhattacharyya
Machine TranslationTranslation

Improving the Performance of English-Tamil Statistical Machine Translation System using Source-Side Pre-Processing

2014-09-29 · M. Anand Kumar, V. Dhanalakshmi, K. P. Soman, V. Sharmiladevi

Machine Translation is one of the major oldest and the most active research area in Natural Language Processing. Currently, Statistical Machine Translation (SMT) dominates the Machine Translation research. Statistical Ma…

Machine TranslationSentenceTranslation