Zero-Shot Adaptive Transfer for Conversational Language Understanding
Conversational agents such as Alexa and Google Assistant constantly need to increase their language understanding capabilities by adding new domains. A massive amount of labeled data is required for training each new domain. While domain adaptation approaches alleviate the annotation cost, prior approaches suffer from increased training time and suboptimal concept alignments. To tackle this, we introduce a novel Zero-Shot Adaptive Transfer method for slot tagging that utilizes the slot description for transferring reusable concepts across domains, and enjoys efficient training without any explicit concept alignments. Extensive experimentation over a dataset of 10 domains relevant to our commercial personal digital assistant shows that our model outperforms previous state-of-the-art systems by a large margin, and achieves an even higher improvement in the low data regime.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationSimilar Papers 제목 키워드 기반
Multi2WOZ: A Robust Multilingual Dataset and Conversational Pretraining for Task-Oriented Dialog
Research on (multi-domain) task-oriented dialog (TOD) has predominantly focused on the English language, primarily due to the shortage of robust TOD datasets in other languages, preventing the systematic investigation of…
Cross-Lingual Transferdialog state trackingRetrievalMulti2WOZ: A Robust Multilingual Dataset and Conversational Pretraining for Task-Oriented Dialog
Research on (multi-domain) task-oriented dialog (TOD) has predominantly focused on the English language, primarily due to the shortage of robust TOD datasets in other languages, preventing the systematic investigation of…
Cross-Lingual Transferdialog state trackingRetrievalMultilingual Question Answering from Formatted Text applied to Conversational Agents
Recent advances with language models (e.g. BERT, XLNet, ...), have allowed surpassing human performance on complex NLP tasks such as Reading Comprehension. However, labeled datasets for training are available mostly in E…
Extractive Question-AnsweringMachine TranslationQuestion AnsweringReading ComprehensionEfficiently Aligned Cross-Lingual Transfer Learning for Conversational Tasks using Prompt-Tuning
Cross-lingual transfer of language models trained on high-resource languages like English has been widely studied for many NLP tasks, but focus on conversational tasks has been rather limited. This is partly due to the h…
Cross-Lingual Transferintent-classificationIntent Classificationslot-filling+2ZeQR: Zero-shot Query Reformulation for Conversational Search
As the popularity of voice assistants continues to surge, conversational search has gained increased attention in Information Retrieval. However, data sparsity issues in conversational search significantly hinder the pro…
Conversational SearchInformation RetrievalMachine Reading ComprehensionReading Comprehension+1