End-to-End Spoken Language Translation
In this paper, we address the task of spoken language understanding. We present a method for translating spoken sentences from one language into spoken sentences in another language. Given spectrogram-spectrogram pairs, our model can be trained completely from scratch to translate unseen sentences. Our method consists of a pyramidal-bidirectional recurrent network combined with a convolutional network to output sentence-level spectrograms in the target language. Empirically, our model achieves competitive performance with state-of-the-art methods on multiple languages and can generalize to unseen speakers.
Code (0)
등록된 구현이 없습니다.
Tasks
SentenceSpoken Language UnderstandingTranslationSimilar Papers 제목 키워드 기반
A Simple Baseline for Spoken Language to Sign Language Translation with 3D Avatars
The objective of this paper is to develop a functional system for translating spoken languages into sign languages, referred to as Spoken2Sign translation. The Spoken2Sign task is orthogonal and complementary to traditio…
Sign Language TranslationTranslationScaling Back-Translation with Domain Text Generation for Sign Language Gloss Translation
Sign language gloss translation aims to translate the sign glosses into spoken language texts, which is challenging due to the scarcity of labeled gloss-text parallel data. Back translation (BT), which generates pseudo-p…
Language ModellingText GenerationTranslationSynthetic Data for Neural Machine Translation of Spoken-Dialects
In this paper, we introduce a novel approach to generate synthetic data for training Neural Machine Translation systems. The proposed approach transforms a given parallel corpus between a written language and a target la…
Machine TranslationTranslationMachine Translation between Spoken Languages and Signed Languages Represented in SignWriting
This paper presents work on novel machine translation (MT) systems between spoken and signed languages, where signed languages are represented in SignWriting, a sign language writing system. Our work seeks to address the…
Machine TranslationSign Language TranslationTranslationData Augmentation for Sign Language Gloss Translation
Sign language translation (SLT) is often decomposed into video-to-gloss recognition and gloss-to-text translation, where a gloss is a sequence of transcribed spoken-language words in the order in which they are signed. W…
Data AugmentationLow Resource Neural Machine TranslationLow-Resource Neural Machine TranslationLow Resource NMT+4