Bicleaner at WMT 2020: Universitat d’Alacant-Prompsit’s submission to the parallel corpus filtering shared task
This paper describes the joint submission of Universitat d’Alacant and Prompsit Language Engineering to the WMT 2020 shared task on parallel corpus filtering. Our submission, based on the free/open-source tool Bicleaner, enhances it with Extremely Randomised Trees and lexical similarity features that account for the frequency of the words in the parallel sentences to determine if two sentences are parallel. To train this classifier we used the clean corpora provided for the task and synthetic noisy parallel sentences. In addition we re-score the output of Bicleaner using character-level language models and n-gram saturation.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
The Universitat d'Alacant Submissions to the English-to-Kazakh News Translation Task at WMT 2019
This paper describes the two submissions of Universitat d{'}Alacant to the English-to-Kazakh news translation task at WMT 2019. Our submissions take advantage of monolingual data and parallel data from other language pai…
Machine TranslationTransfer LearningTranslationUAlacant machine translation quality estimation at WMT 2018: a simple approach using phrase tables and feed-forward neural networks
We describe the Universitat d'Alacant submissions to the word- and sentence-level machine translation (MT) quality estimation (QE) shared task at WMT 2018. Our approach to word-level MT QE builds on previous work to mark…
Machine TranslationSentenceTranslationPrompsit's submission to WMT 2018 Parallel Corpus Filtering shared task
This paper describes Prompsit Language Engineering{'}s submissions to the WMT 2018 parallel corpus filtering shared task. Our four submissions were based on an automatic classifier for identifying pairs of sentences that…
Active LearningLanguage ModelingLanguage ModellingMachine TranslationBicleaner AI: Bicleaner Goes Neural
This paper describes the experiments carried out during the development of the latest version of Bicleaner, named Bicleaner AI, a tool that aims at detecting noisy sentences in parallel corpora. The tool, which now imple…
Binary ClassificationMachine TranslationNMTTranslationPrompsit’s Submission to the IWSLT 2018 Low Resource Machine Translation Task
This paper presents Prompsit Language Engineering’s submission to the IWSLT 2018 Low Resource Machine Translation task. Our submission is based on cross-lingual learning: a multilingual neural machine translation system …
Machine TranslationTranslation