Parallel sentences mining with transfer learning in an unsupervised setting
The quality and quantity of parallel sentences are known as very important training data for constructing neural machine translation (NMT) systems. However, these resources are not available for many low-resource language pairs. Many existing methods need strong supervision are not suitable. Although several attempts at developing unsupervised models, they ignore the language-invariant between languages. In this paper, we propose an approach based on transfer learning to mine parallel sentences in the unsupervised setting.With the help of bilingual corpora of rich-resource language pairs, we can mine parallel sentences without bilingual supervision of low-resource language pairs. Experiments show that our approach improves the performance of mined parallel sentences compared with previous methods. In particular, we achieve excellent results at two real-world low-resource language pairs.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationNMTTransfer LearningTranslationSimilar Papers 제목 키워드 기반
Unsupervised Parallel Sentence Extraction with Parallel Segment Detection Helps Machine Translation
Mining parallel sentences from comparable corpora is important. Most previous work relies on supervised systems, which are trained on parallel data, thus their applicability is problematic in low-resource scenarios. Rece…
Machine TranslationSentenceTranslationWord EmbeddingsPD3: Better Low-Resource Cross-Lingual Transfer By Combining Direct Transfer and Annotation Projection
We consider unsupervised cross-lingual transfer on two tasks, viz., sentence-level argumentation mining and standard POS tagging. We combine direct transfer using bilingual embeddings with annotation projection, which pr…
Argument MiningCross-Lingual TransferMulti-Task LearningPOS+3Unsupervised Parallel Sentence Extraction from Comparable Corpora
Mining parallel sentences from comparable corpora is of great interest for many downstream tasks. In the BUCC 2017 shared task, systems performed well by training on gold standard parallel sentences. However, we often wa…
SentenceWord EmbeddingsBilingual alignment transfers to multilingual alignment for unsupervised parallel text mining
This work presents methods for learning cross-lingual sentence representations using paired or unpaired bilingual texts. We hypothesize that the cross-lingual alignment strategy is transferable, and therefore a model tra…
Language ModelingLanguage ModellingRetrievalSentence+1Tweet to News Conversion: An Investigation into Unsupervised Controllable Text Generation
Text generator systems have become extremely popular with the advent of recent deep learning models such as encoder-decoder. Controlling the information and style of the generated output without supervision is an importa…
DecoderStyle TransferText Generation