Building a Task-oriented Dialog System for Languages with no Training Data: the Case for Basque
This paper presents an approach for developing a task-oriented dialog system for less-resourced languages in scenarios where training data is not available. Both intent classification and slot filling are tackled. We project the existing annotations in rich-resource languages by means of Neural Machine Translation (NMT) and posterior word alignments. We then compare training on the projected monolingual data with direct model transfer alternatives. Intent Classifiers and slot filling sequence taggers are implemented using a BiLSTM architecture or by fine-tuning BERT transformer models. Models learnt exclusively from Basque projected data provide better accuracies for slot filling. Combining Basque projected train data with rich-resource languages data outperforms consistently models trained solely on projected data for intent classification. At any rate, we achieve competitive performance in both tasks, with accuracies of 81{\%} for intent classification and 77{\%} for slot filling.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationGeneral Classificationintent-classificationIntent ClassificationIntent Classification and Slot FillingMachine TranslationNMTslot-fillingSlot FillingTranslationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
ViWOZ: A Multi-Domain Task-Oriented Dialogue Systems Dataset For Low-resource Language
Most of the current task-oriented dialogue systems (ToD), despite having interesting results, are designed for a handful of languages like Chinese and English. Therefore, their performance in low-resource languages is st…
Task-Oriented Dialogue SystemsNatural Language Processing for Multilingual Task-Oriented Dialogue
Recent advances in deep learning have also enabled fast progress in the research of task-oriented dialogue (ToD) systems. However, the majority of ToD systems are developed for English and merely a handful of other widel…
HCLD: A Hierarchical Framework for Zero-shot Cross-lingual Dialogue System
Recently, many task-oriented dialogue systems need to serve users in different languages. However, it is time-consuming to collect enough data of each language for training. Thus, zero-shot adaptation of cross-lingual ta…
Intent DetectionSentenceslot-fillingSlot Filling+1Building blocks of a task-oriented dialogue system in the healthcare domain
There has been significant progress in dialogue systems research. However, dialogue systems research in the healthcare domain is still in its infancy. In this paper, we analyse recent studies and outline three building b…
Dialogue ManagementManagementPrivacy PreservingAn Empirical Study of Cross-Lingual Transferability in Generative Dialogue State Tracker
There has been a rapid development in data-driven task-oriented dialogue systems with the benefit of large-scale datasets. However, the progress of dialogue systems in low-resource languages lags far behind due to the la…
dialog state trackingDialogue State TrackingTask-Oriented Dialogue Systems