Source-Critical Reinforcement Learning for Transferring Spoken Language Understanding to a New Language
To deploy a spoken language understanding (SLU) model to a new language, language transferring is desired to avoid the trouble of acquiring and labeling a new big SLU corpus. Translating the original SLU corpus into the target language is an attractive strategy. However, SLU corpora consist of plenty of semantic labels (slots), which general-purpose translators cannot handle well, not to mention additional culture differences. This paper focuses on the language transferring task given a tiny in-domain parallel SLU corpus. The in-domain parallel corpus can be used as the first adaptation on the general translator. But more importantly, we show how to use reinforcement learning (RL) to further finetune the adapted translator, where translated sentences with more proper slot tags receive higher rewards. We evaluate our approach on Chinese to English language transferring for SLU systems. The experimental results show that the generated English SLU corpus via adaptation and reinforcement learning gives us over 97% in the slot F1 score and over 84% accuracy in domain classification. It demonstrates the effectiveness of the proposed language transferring method. Compared with naive translation, our proposed method improves domain classification accuracy by relatively 22%, and the slot filling F1 score by relatively more than 71%.
Code (0)
등록된 구현이 없습니다.
Tasks
Cultural Vocal Bursts Intensity Predictiondomain classificationGeneral Classificationreinforcement-learningReinforcement LearningReinforcement Learning (RL)slot-fillingSlot FillingSpoken Language UnderstandingSimilar Papers 제목 키워드 기반
Source Critical Reinforcement Learning for Transferring Spoken Language Understanding to a New Language
To deploy a spoken language understanding (SLU) model to a new language, language transferring is desired to avoid the trouble of acquiring and labeling a new big SLU corpus. An SLU corpus is a monolingual corpus with do…
Cultural Vocal Bursts Intensity Predictiondomain classificationGeneral ClassificationMachine Translation+7Transferring SLU Models in Novel Domains
Spoken language understanding (SLU) is a critical component in building dialogue systems. When building models for novel natural language domains, a major challenge is the lack of data in the new domains, no matter wheth…
Intent RecognitionMeta-Learningslot-fillingSlot Filling+2KVoiceBench, KOpenAudioBench, and KMMAU: Agent-Driven Korean Speech Benchmarks for Evaluating SpeechLMs
Speech language models (SpeechLMs) have achieved substantial progress by extending large language models (LLMs) to the speech modality. However, SpeechLM evaluation remains heavily centered on English, limiting reliable …
Advancing Speech Summarization in Multi-modal LLMs with Reinforcement Learning
Speech summarization is a critical component of spoken content understanding, particularly in the era of rapidly growing spoken and audiovisual data. Recent advances in multi-modal large language models (MLLMs), leveragi…
Zero-shot GeneralizationReinforcement LearningIsochrony-Aware Neural Machine Translation for Automatic Dubbing
We introduce the task of isochrony-aware machine translation which aims at generating translations suitable for dubbing. Dubbing of a spoken sentence requires transferring the content as well as the speech-pause structur…
Machine TranslationSentenceTranslation