Phrase Table Induction Using In-Domain Monolingual Data for Domain Adaptation in Statistical Machine Translation
We present a new framework to induce an in-domain phrase table from in-domain monolingual data that can be used to adapt a general-domain statistical machine translation system to the targeted domain. Our method first compiles sets of phrases in source and target languages separately and generates candidate phrase pairs by taking the Cartesian product of the two phrase sets. It then computes inexpensive features for each candidate phrase pair and filters them using a supervised classifier in order to induce an in-domain phrase table. We experimented on the language pair English{--}French, both translation directions, in two domains and obtained consistently better results than a strong baseline system that uses an in-domain bilingual lexicon. We also conducted an error analysis that showed the induced phrase tables proposed useful translations, especially for words and phrases unseen in the parallel data used to train the general-domain baseline system.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationMachine TranslationTranslationSimilar Papers 제목 키워드 기반
Cross-Domain Bilingual Lexicon Induction via Pretrained Language Models
Bilingual Lexicon Induction (BLI) is generally based on common domain data to obtain monolingual word embedding, and by aligning the monolingual word embeddings to obtain the cross-lingual embeddings which are used to ge…
Bilingual Lexicon InductionWord EmbeddingsWord TranslationMonolingually Derived Phrase Scores for Phrase Based SMT Using Neural Networks Vector Representations
In this paper, we propose two new features for estimating phrase-based machine translation parameters from mainly monolingual data. Our method is based on two recently introduced neural network vector representation mode…
Machine TranslationTranslationBilingual Lexicon Induction through Unsupervised Machine Translation
A recent research line has obtained strong results on bilingual lexicon induction by aligning independently trained word embeddings in two languages and using the resulting cross-lingual embeddings to induce word transla…
Bilingual Lexicon InductionLanguage ModelingLanguage ModellingMachine Translation+6Improving Bilingual Lexicon Induction with Unsupervised Post-Processing of Monolingual Word Vector Spaces
Work on projection-based induction of cross-lingual word embedding spaces (CLWEs) predominantly focuses on the improvement of the projection (i.e., mapping) mechanisms. In this work, in contrast, we show that a simple me…
Bilingual Lexicon InductionImproving Translation of Out Of Vocabulary Words using Bilingual Lexicon Induction in Low-Resource Machine Translation
Dictionary-based data augmentation techniques have been used in the field of domain adaptation to learn words that do not appear in the parallel training data of a machine translation model. These techniques strive to le…
Bilingual Lexicon InductionData AugmentationDomain AdaptationMachine Translation+3