Multilingual Speech Translation with Unified Transformer: Huawei Noah's Ark Lab at IWSLT 2021
This paper describes the system submitted to the IWSLT 2021 Multilingual Speech Translation (MultiST) task from Huawei Noah's Ark Lab. We use a unified transformer architecture for our MultiST model, so that the data from different modalities (i.e., speech and text) and different tasks (i.e., Speech Recognition, Machine Translation, and Speech Translation) can be exploited to enhance the model's ability. Specifically, speech and text inputs are firstly fed to different feature extractors to extract acoustic and textual features, respectively. Then, these features are processed by a shared encoder--decoder architecture. We apply several training techniques to improve the performance, including multi-task learning, task-level curriculum learning, data augmentation, etc. Our final system achieves significantly better results than bilingual baselines on supervised language pairs and yields reasonable results on zero-shot language pairs.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationDecoderMachine TranslationMulti-Task Learningspeech-recognitionSpeech RecognitionTranslationSimilar Papers 제목 키워드 기반
Multilingual Speech Translation with Unified Transformer: Huawei Noah’s Ark Lab at IWSLT 2021
This paper describes the system submitted to the IWSLT 2021 Multilingual Speech Translation (MultiST) task from Huawei Noah’s Ark Lab. We use a unified transformer architecture for our MultiST model, so that the data fro…
Data AugmentationDecoderMachine TranslationMulti-Task Learning+3Multilingual Transfer and Domain Adaptation for Low-Resource Languages of Spain
This article introduces the submission status of the Translation into Low-Resource Languages of Spain task at (WMT 2024) by Huawei Translation Service Center (HW-TSC). We participated in three translation tasks: spanish …
DenoisingDomain AdaptationEnsemble LearningMachine Translation+2HW-TSC’s Participation in the WMT 2021 Large-Scale Multilingual Translation Task
This paper presents the submission of Huawei Translation Services Center (HW-TSC) to the WMT 2021 Large-Scale Multilingual Translation Task. We participate in Samll Track #2, including 6 languages: Javanese (Jv), Indones…
Knowledge DistillationTranslationHW-TSC’s Participation in the WMT 2021 Triangular MT Shared Task
This paper presents the submission of Huawei Translation Service Center (HW-TSC) to WMT 2021 Triangular MT Shared Task. We participate in the Russian-to-Chinese task under the constrained condition. We use Transformer ar…
DenoisingTranslationHW-TSC’s Participation in the WMT 2021 News Translation Shared Task
This paper presents the submission of Huawei Translate Services Center (HW-TSC) to the WMT 2021 News Translation Shared Task. We participate in 7 language pairs, including Zh/En, De/En, Ja/En, Ha/En, Is/En, Hi/Bn, and Xh…
de-enKnowledge DistillationTranslation