paper-with-me

Papers

Improving Cascaded Unsupervised Speech Translation with Denoising Back-translation

2023-05-12 · Yu-Kuan Fu, Liang-Hsuan Tseng, Jiatong Shi, Chen-An Li, Tsu-Yuan Hsu, Shinji Watanabe, Hung-Yi Lee

Most of the speech translation models heavily rely on parallel data, which is hard to collect especially for low-resource languages. To tackle this issue, we propose to build a cascaded speech translation system without leveraging any kind of paired data. We use fully unpaired data to train our unsupervised systems and evaluate our results on CoVoST 2 and CVSS. The results show that our work is comparable with some other early supervised methods in some language pairs. While cascaded systems always suffer from severe error propagation problems, we proposed denoising back-translation (DBT), a novel approach to building robust unsupervised neural machine translation (UNMT). DBT successfully increases the BLEU score by 0.7--0.9 in all three translation directions. Moreover, we simplified the pipeline of our cascaded system to reduce inference latency and conducted a comprehensive analysis of every part of our work. We also demonstrate our unsupervised speech translation results on the established website.

📄 PDF Abstract BibTeX arXiv:2305.07455

Code (0)

등록된 구현이 없습니다.

Tasks

DenoisingMachine TranslationTranslation

Similar Papers 제목 키워드 기반

Towards Unsupervised Speech-to-Text Translation

2018-11-04 · Yu-An Chung, Wei-Hung Weng, Schrasing Tong, James Glass

We present a framework for building speech-to-text translation (ST) systems using only monolingual speech and text corpora, in other words, speech utterances from a source language and independent text from a target lang…

DenoisingLanguage ModelingLanguage ModellingSpeech-to-Text+3

Direct Simultaneous Speech-to-Speech Translation with Variational Monotonic Multihead Attention

2021-10-15 · Xutai Ma, Hongyu Gong, Danni Liu, Ann Lee 외

We present a direct simultaneous speech-to-speech translation (Simul-S2ST) model, Furthermore, the generation of translation is independent from intermediate text representations. Our approach leverages recent progress o…

Simultaneous Speech-to-Speech TranslationSpeech SynthesisSpeech-to-Speech TranslationTranslation

Bemba Speech Translation: Exploring a Low-Resource African Language

2025-05-05 · Muhammad Hazim Al Farouq, Aman Kassahun Wassie, Yasmin Moslem

This paper describes our system submission to the International Conference on Spoken Language Translation (IWSLT 2025), low-resource languages track, namely for Bemba-to-English speech translation. We built cascaded spee…

Data AugmentationTranslation

HydraQE: OSU's Submission for the IWSLT 2026 Speech Translation Metrics Shared Task

2026-06-07 · Kevin Krahn, Eric Fosler-Lussier arxiv

We present HydraQE, our contribution to the IWSLT 2026 Speech Translation Metrics shared task. HydraQE is an end-to-end, reference-free quality estimation (QE) system for speech translation built on a Qwen3-ASR backbone,…

Machine Translation

ZJU’s IWSLT 2021 Speech Translation System

2021-08-01 · ACL (IWSLT) 2021 8 · Linlin Zhang

In this paper, we describe Zhejiang University’s submission to the IWSLT2021 Multilingual Speech Translation Task. This task focuses on speech translation (ST) research across many non-English source languages. Participa…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Machine TranslationNMT+3