Mixture Models for Diverse Machine Translation: Tricks of the Trade
Facebook AI Research Sequence-to-Sequence Toolkit written in Python.
Code (1)
Tasks
Machine TranslationText GenerationTranslationSimilar Papers 제목 키워드 기반
Mixture-of-Supernets: Improving Weight-Sharing Supernet Training with Architecture-Routed Mixture-of-Experts
Weight-sharing supernets are crucial for performance estimation in cutting-edge neural architecture search (NAS) frameworks. Despite their ability to generate diverse subnetworks without retraining, the quality of these …
Language ModelingLanguage ModellingMachine TranslationMixture-of-Experts+2Universal Simultaneous Machine Translation with Mixture-of-Experts Wait-k Policy
Simultaneous machine translation (SiMT) generates translation before reading the entire source sentence and hence it has to trade off between translation quality and latency. To fulfill the requirements of different tran…
Machine TranslationMixture-of-ExpertsSentenceTranslationFully Non-autoregressive Neural Machine Translation: Tricks of the Trade
Fully non-autoregressive neural machine translation (NAT) is proposed to simultaneously predict tokens with single forward of neural networks, which significantly reduces the inference latency at the expense of quality d…
Machine TranslationTranslationA Bag of Useful Tricks for Practical Neural Machine Translation: Embedding Layer Initialization and Large Batch Size
In this paper, we describe the team UT-IIS{'}s system and results for the WAT 2017 translation tasks. We further investigated several tricks including a novel technique for initializing embedding layers using only the pa…
Machine TranslationTranslationWord EmbeddingsPragmatic Neural Language Modelling in Machine Translation
This paper presents an in-depth investigation on integrating neural language models in translation systems. Scaling neural language models is a difficult task, but crucial for real-world applications. This paper evaluate…
Language ModelingLanguage ModellingMachine TranslationTranslation