paper-with-me

홈 › Papers

Robust Neural Machine Translation for Clean and Noisy Speech Transcripts

2019-10-22 · EMNLP (IWSLT) 2019 11 · Mattia Antonino Di Gangi, Robert Enyedi, Alessandra Brusadin, Marcello Federico

Neural machine translation models have shown to achieve high quality when trained and fed with well structured and punctuated input texts. Unfortunately, the latter condition is not met in spoken language translation, where the input is generated by an automatic speech recognition (ASR) system. In this paper, we study how to adapt a strong NMT system to make it robust to typical ASR errors. As in our application scenarios transcripts might be post-edited by human experts, we propose adaptation strategies to train a single system that can translate either clean or noisy input with no supervision on the input type. Our experimental results on a public speech translation data set show that adapting a model on a significant amount of parallel data including ASR transcripts is beneficial with test data of the same type, but produces a small degradation when translating clean text. Adapting on both clean and noisy variants of the same data leads to the best results on both input types.

📄 PDF Abstract BibTeX arXiv:1910.10238

Code (0)

등록된 구현이 없습니다.

Tasks

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Machine TranslationNMTspeech-recognitionSpeech RecognitionTranslation

Methods 이 논문이 사용한 방법론

Test 설명 없음

Similar Papers 제목 키워드 기반

Microsoft Speech Language Translation (MSLT) Corpus: The IWSLT 2016 release for English, French and German

2016-12-01 · IWSLT 2016 12 · Christian Federmann, William D. Lewis

We describe the Microsoft Speech Language Translation (MSLT) corpus, which was created in order to evaluate end-to-end conversational speech translation quality. The corpus was created from actual conversations over Skyp…

Machine Translationspeech-recognitionSpeech RecognitionTranslation

Improving Neural Machine Translation Robustness via Data Augmentation: Beyond Back Translation

2019-10-07 · Zhenhao Li, Lucia Specia

Neural Machine Translation (NMT) models have been proved strong when translating clean texts, but they are very sensitive to noise in the input. Improving NMT models robustness can be seen as a form of "domain" adaption …

Data AugmentationDiversityDomain AdaptationForm+3

Improving Neural Machine Translation Robustness via Data Augmentation: Beyond Back-Translation

2019-11-01 · WS 2019 11 · Zhenhao Li, Lucia Specia

Neural Machine Translation (NMT) models have been proved strong when translating clean texts, but they are very sensitive to noise in the input. Improving NMT models robustness can be seen as a form of {``}domain{''} ada…

Data AugmentationDiversityDomain AdaptationForm+3

A Case Study on Filtering for End-to-End Speech Translation

2024-02-02 · Md Mahfuz ibn Alam, Antonios Anastasopoulos

It is relatively easy to mine a large parallel corpus for any machine learning task, such as speech-to-text or speech-to-speech translation. Although these mined corpora are large in volume, their quality is questionable…

Speech-to-Speech TranslationSpeech-to-TextTranslation

Breaking the Data Barrier: Towards Robust Speech Translation via Adversarial Stability Training

2019-09-25 · EMNLP (IWSLT) 2019 11 · Qiao Cheng, Meiyuan Fang, Yaqian Han, Jin Huang 외

In a pipeline speech translation system, automatic speech recognition (ASR) system will transmit errors in recognition to the downstream machine translation (MT) system. A standard machine translation system is usually t…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Data AugmentationDecoder+4