Noisy Parallel Corpus Filtering through Projected Word Embeddings
We present a very simple method for parallel text cleaning of low-resource languages, based on projection of word embeddings trained on large monolingual corpora in high-resource languages. In spite of its simplicity, we approach the strong baseline system in the downstream machine translation evaluation.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationTranslationWord EmbeddingsSimilar Papers 제목 키워드 기반
Accurate semantic textual similarity for cleaning noisy parallel corpora using semantic machine translation evaluation metric: The NRC supervised submissions to the Parallel Corpus Filtering task
We present our semantic textual similarity approach in filtering a noisy web crawled parallel corpus using YiSi{---}a novel semantic machine translation evaluation metric. The systems mainly based on this supervised appr…
Machine TranslationSemantic Textual SimilarityTranslationCoverage and Cynicism: The AFRL Submission to the WMT 2018 Parallel Corpus Filtering Task
The WMT 2018 Parallel Corpus Filtering Task aims to test various methods of filtering a noisy parallel corpus, to make it useful for training machine translation systems. We describe the AFRL submissions, including their…
Machine TranslationTranslationDual Conditional Cross-Entropy Filtering of Noisy Parallel Corpora
In this work we introduce dual conditional cross-entropy filtering for noisy parallel data. For each sentence pair of the noisy parallel corpus we compute cross-entropy scores according to two inverse translation models …
SentenceTranslationNICT's Corpus Filtering Systems for the WMT18 Parallel Corpus Filtering Task
This paper presents the NICT's participation in the WMT18 shared parallel corpus filtering task. The organizers provided 1 billion words German-English corpus crawled from the web as part of the Paracrawl project. This c…
Machine TranslationNMTSentenceTranslationQuality and Coverage: The AFRL Submission to the WMT19 Parallel Corpus Filtering for Low-Resource Conditions Task
The WMT19 Parallel Corpus Filtering For Low-Resource Conditions Task aims to test various methods of filtering a noisy parallel corpora, to make them useful for training machine translation systems. This year the noisy c…
Machine TranslationTranslation