paper-with-me

Papers

Source-Critical Reinforcement Learning for Transferring Spoken Language Understanding to a New Language

2018-08-19 · He Bai, Yu Zhou, Jiajun Zhang, Liang Zhao, Mei-Yuh Hwang, Cheng-qing Zong

To deploy a spoken language understanding (SLU) model to a new language, language transferring is desired to avoid the trouble of acquiring and labeling a new big SLU corpus. Translating the original SLU corpus into the target language is an attractive strategy. However, SLU corpora consist of plenty of semantic labels (slots), which general-purpose translators cannot handle well, not to mention additional culture differences. This paper focuses on the language transferring task given a tiny in-domain parallel SLU corpus. The in-domain parallel corpus can be used as the first adaptation on the general translator. But more importantly, we show how to use reinforcement learning (RL) to further finetune the adapted translator, where translated sentences with more proper slot tags receive higher rewards. We evaluate our approach on Chinese to English language transferring for SLU systems. The experimental results show that the generated English SLU corpus via adaptation and reinforcement learning gives us over 97% in the slot F1 score and over 84% accuracy in domain classification. It demonstrates the effectiveness of the proposed language transferring method. Compared with naive translation, our proposed method improves domain classification accuracy by relatively 22%, and the slot filling F1 score by relatively more than 71%.

📄 PDF Abstract BibTeX arXiv:1808.06167

Code (0)

등록된 구현이 없습니다.

Tasks

Cultural Vocal Bursts Intensity Predictiondomain classificationGeneral Classificationreinforcement-learningReinforcement LearningReinforcement Learning (RL)slot-fillingSlot FillingSpoken Language Understanding

Similar Papers 제목 키워드 기반

Source Critical Reinforcement Learning for Transferring Spoken Language Understanding to a New Language

2018-08-01 · COLING 2018 8 · He Bai, Yu Zhou, Jiajun Zhang, Liang Zhao 외

To deploy a spoken language understanding (SLU) model to a new language, language transferring is desired to avoid the trouble of acquiring and labeling a new big SLU corpus. An SLU corpus is a monolingual corpus with do…

Cultural Vocal Bursts Intensity Predictiondomain classificationGeneral ClassificationMachine Translation+7

Transferring SLU Models in Novel Domains

2019-05-01 · ICLR 2019 5 · Yaohua Tang, Kaixiang Mo, Qian Xu, Chao Zhang 외

Spoken language understanding (SLU) is a critical component in building dialogue systems. When building models for novel natural language domains, a major challenge is the lack of data in the new domains, no matter wheth…

Intent RecognitionMeta-Learningslot-fillingSlot Filling+2

KVoiceBench, KOpenAudioBench, and KMMAU: Agent-Driven Korean Speech Benchmarks for Evaluating SpeechLMs

2026-05-27 · Haechan Kim, Seungjun Chung, Inkyu Park, Jihoo Lee 외 arxiv

Speech language models (SpeechLMs) have achieved substantial progress by extending large language models (LLMs) to the speech modality. However, SpeechLM evaluation remains heavily centered on English, limiting reliable …

Advancing Speech Summarization in Multi-modal LLMs with Reinforcement Learning

2025-09-23 · Shaoshi Ling, Gang Liu, Guoli Ye, Jinyu Li arxiv

Speech summarization is a critical component of spoken content understanding, particularly in the era of rapidly growing spoken and audiovisual data. Recent advances in multi-modal large language models (MLLMs), leveragi…

Zero-shot GeneralizationReinforcement Learning

Isochrony-Aware Neural Machine Translation for Automatic Dubbing

2021-12-16 · Derek Tam, Surafel M. Lakew, Yogesh Virkar, Prashant Mathur 외

We introduce the task of isochrony-aware machine translation which aims at generating translations suitable for dubbing. Dubbing of a spoken sentence requires transferring the content as well as the speech-pause structur…

Machine TranslationSentenceTranslation