Amazon Alexa AI’s System for IWSLT 2022 Offline Speech Translation Shared Task
This paper describes Amazon Alexa AI’s submission to the IWSLT 2022 Offline Speech Translation Task. Our system is an end-to-end speech translation model that leverages pretrained models and cross modality transfer learning. We detail two improvements to the knowledge transfer schema. First, we implemented a new loss function that reduces knowledge gap between audio and text modalities in translation task effectively. Second, we investigate multiple finetuning strategies including sampling loss, language grouping and domain adaption. These strategies aims to bridge the gaps between speech and text translation tasks. We also implement a multi-stage segmentation and merging strategy that yields improvements on the unsegmented development datasets. Results show that the proposed loss function consistently improves BLEU scores on the development datasets for both English-German and multilingual models. Additionally, certain language pairs see BLEU score improvements with specific finetuning strategies.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationTransfer LearningTranslationSimilar Papers 제목 키워드 기반
CUNI-KIT System for Simultaneous Speech Translation Task at IWSLT 2022
In this paper, we describe our submission to the Simultaneous Speech Translation at IWSLT 2022. We explore strategies to utilize an offline model in a simultaneous setting without the need to modify the original model. I…
TranslationEnd-to-End Offline Speech Translation System for IWSLT 2020 using Modality Agnostic Meta-Learning
In this paper, we describe the system submitted to the IWSLT 2020 Offline Speech Translation Task. We adopt the Transformer architecture coupled with the meta-learning approach to build our end-to-end Speech-to-Text Tran…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Data AugmentationMachine Translation+6ELITR Non-Native Speech Translation at IWSLT 2020
This paper is an ELITR system submission for the non-native speech translation task at IWSLT 2020. We describe systems for offline ASR, real-time ASR, and our cascaded approach to offline SLT and real-time SLT. We select…
TranslationThe Volctrans Neural Speech Translation System for IWSLT 2021
This paper describes the systems submitted to IWSLT 2021 by the Volctrans team. We participate in the offline speech translation and text-to-text simultaneous translation tracks. For offline speech translation, our best …
TranslationDiDi Labs' End-to-end System for the IWSLT 2020 Offline Speech TranslationTask
This paper describes the system that was submitted by DiDi Labs to the offline speech translation task for IWSLT 2020. We trained an end-to-end system that translates audio from English TED talks to German text, without …
Translation