Improved Long-Form Spoken Language Translation with Large Language Models
A challenge in spoken language translation is that plenty of spoken content is long-form, but short units are necessary for obtaining high-quality translations. To address this mismatch, we fine-tune a general-purpose, large language model to split long ASR transcripts into segments that can be independently translated so as to maximize the overall translation quality. We compare to several segmentation strategies and find that our approach improves BLEU score on three languages by an average of 2.7 BLEU overall compared to an automatic punctuation baseline. Further, we demonstrate the effectiveness of two constrained decoding strategies to improve well-formedness of the model output from above 99% to 100%.
Code (0)
등록된 구현이 없습니다.
Tasks
FormLanguage ModelingLanguage ModellingLarge Language ModelTranslationSimilar Papers 제목 키워드 기반
Augmenting Translation Models with Simulated Acoustic Confusions for Improved Spoken Language Translation
Dynamic Masking for Improved Stability in Online Spoken Language Translation
Dynamic Masking for Improved Stability in Spoken Language Translation
For spoken language translation (SLT) in live scenarios such as conferences, lectures and meetings, it is desirable to show the translation to the user as quickly as possible, avoiding an annoying lag between speaker and…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Machine Translationspeech-recognition+2Clean Text and Full-Body Transformer: Microsoft's Submission to the WMT22 Shared Task on Sign Language Translation
This paper describes Microsoft's submission to the first shared task on sign language translation at WMT 2022, a public competition tackling sign language to spoken language translation for Swiss German sign language. Th…
Action RecognitionLip ReadingSign Language TranslationTranslationA Simple Baseline for Spoken Language to Sign Language Translation with 3D Avatars
The objective of this paper is to develop a functional system for translating spoken languages into sign languages, referred to as Spoken2Sign translation. The Spoken2Sign task is orthogonal and complementary to traditio…
Sign Language TranslationTranslation