Semi-Supervised Translation with MMD Networks
This work aims to improve semi-supervised learning in a neural network architecture by introducing a hybrid supervised and unsupervised cost function. The unsupervised component is trained using a differentiable estimator of the Maximum Mean Discrepancy (MMD) distance between the network output and the target dataset. We introduce the notion of an $n$-channel network and several methods to improve performance of these nets based on supervised pre-initialization, and multi-scale kernels. This work investigates the effectiveness of these methods on language translation where very few quality translations are known \textit{a priori}. We also present a thorough investigation of the hyper-parameter space of this method on both synthetic data.
Code (0)
등록된 구현이 없습니다.
Tasks
Single Image DerainingTranslationSimilar Papers 제목 키워드 기반
Semi-supervised Learning for Few-shot Image-to-Image Translation
In the last few years, unpaired image-to-image translation has witnessed remarkable progress. Although the latest methods are able to generate realistic images, they crucially rely on a large number of labeled images. Re…
Image-to-Image TranslationTranslationSemi-Supervised and Unsupervised Sense Annotation via Translations
Acquisition of multilingual training data continues to be a challenge in word sense disambiguation (WSD). To address this problem, unsupervised approaches have been proposed to automatically generate sense annotations fo…
Machine TranslationTranslationWord Sense DisambiguationA Simple Baseline to Semi-Supervised Domain Adaptation for Machine Translation
State-of-the-art neural machine translation (NMT) systems are data-hungry and perform poorly on new domains with no supervised data. As data collection is expensive and infeasible in many cases, domain adaptation methods…
Domain AdaptationLanguage ModelingLanguage ModellingMachine Translation+4A Semi-Paired Approach For Label-to-Image Translation
Data efficiency, or the ability to generalize from a few labeled data, remains a major challenge in deep learning. Semi-supervised learning has thrived in traditional recognition tasks alleviating the need for large amou…
Image-to-Image TranslationTranslationMachine Translation Model based on Non-parallel Corpus and Semi-supervised Transductive Learning
Although the parallel corpus has an irreplaceable role in machine translation, its scale and coverage is still beyond the actual needs. Non-parallel corpus resources on the web have an inestimable potential value in mach…
Machine TranslationTransductive LearningTranslation