paper-with-me

홈 › Papers

Fine-tuning on Clean Data for End-to-End Speech Translation: FBK @ IWSLT 2018

2018-10-16 · IWSLT (EMNLP) 2018 10 · Mattia Antonino Di Gangi, Roberto Dessì, Roldano Cattoni, Matteo Negri, Marco Turchi

This paper describes FBK's submission to the end-to-end English-German speech translation task at IWSLT 2018. Our system relies on a state-of-the-art model based on LSTMs and CNNs, where the CNNs are used to reduce the temporal dimension of the audio input, which is in general much higher than machine translation input. Our model was trained only on the audio-to-text parallel data released for the task, and fine-tuned on cleaned subsets of the original training corpus. The addition of weight normalization and label smoothing improved the baseline system by 1.0 BLEU point on our validation set. The final submission also featured checkpoint averaging within a training run and ensemble decoding of models trained during multiple runs. On test data, our best single model obtained a BLEU score of 9.7, while the ensemble obtained a BLEU score of 10.24.

📄 PDF Abstract BibTeX arXiv:1810.07652

Code (0)

등록된 구현이 없습니다.

Tasks

Machine TranslationTranslation

Methods 이 논문이 사용한 방법론

Weight Normalization Weight Normalization is a normalization method for training neural networks. It is inspired by batch normalization,…

Similar Papers 제목 키워드 기반

Arabic Hate Speech Identification and Masking in Social Media using Deep Learning Models and Pre-trained Models Fine-tuning

2025-07-31 · Salam Thabet Doghmash, Motaz Saad arxiv

Hate speech identification in social media has become an increasingly important issue in recent years. In this research, we address two problems: 1) to detect hate speech in Arabic text, 2) to clean a given text from hat…

Hate Speech DetectionMachine Translation

The Sogou-TIIC Speech Translation System for IWSLT 2018

2018-10-01 · IWSLT (EMNLP) 2018 10 · Yuguang Wang, Liangliang Shi, Linyu Wei, Weifeng Zhu 외

This paper describes our speech translation system for the IWSLT 2018 Speech Translation of lectures and TED talks from English to German task. The pipeline approach is employed in our work, which mainly includes the Aut…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Language ModelingLanguage Modelling+5

PiDA: Phonetically-Informed Data Augmentation for Robust Vietnamese Speech Translation

2026-06-11 · Giang Son Nguyen, Tung X. Nguyen, Hieu Minh Truong, Nhu Vo 외 arxiv

Cascaded speech translation (ST) systems suffer from error propagation when Automatic Speech Recognition (ASR) outputs incorrect transcripts. We present the first systematic categorization of ASR errors for Vietnamese ST…

Machine TranslationSpeech RecognitionData Augmentation

Finetuning End-to-End Models for Estonian Conversational Spoken Language Translation

2024-07-04 · Tiia Sildam, Andra Velve, Tanel Alumäe

This paper investigates the finetuning of end-to-end models for bidirectional Estonian-English and Estonian-Russian conversational speech-to-text translation. Due to the limited availability of speech translation data fo…

Machine Translationspeech-recognitionSpeech RecognitionSpeech-to-Text+2

Towards Fluent Translations from Disfluent Speech

2018-11-07 · Elizabeth Salesky, Susanne Burger, Jan Niehues, Alex Waibel

When translating from speech, special consideration for conversational speech phenomena such as disfluencies is necessary. Most machine translation training data consists of well-formed written texts, causing issues when…

Machine Translationspeech-recognitionSpeech RecognitionTranslation