Natural language understanding for task oriented dialog in the biomedical domain in a low resources context
In the biomedical domain, the lack of sharable datasets often limit the possibility of developing natural language processing systems, especially dialogue applications and natural language understanding models. To overcome this issue, we explore data generation using templates and terminologies and data augmentation approaches. Namely, we report our experiments using paraphrasing and word representations learned on a large EHR corpus with Fasttext and ELMo, to learn a NLU model without any available dataset. We evaluate on a NLU task of natural language queries in EHRs divided in slot-filling and intent classification sub-tasks. On the slot-filling task, we obtain a F-score of 0.76 with the ELMo representation; and on the classification task, a mean F-score of 0.71. Our results show that this method could be used to develop a baseline system.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationGeneral Classificationintent-classificationIntent ClassificationNatural Language QueriesNatural Language Understandingslot-fillingSlot FillingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
DialoGLUE: A Natural Language Understanding Benchmark for Task-Oriented Dialogue
A long-standing goal of task-oriented dialogue research is the ability to flexibly adapt dialogue models to new domains. To progress research in this direction, we introduce DialoGLUE (Dialogue Language Understanding Eva…
Domain AdaptationMulti-domain Dialogue State TrackingNatural Language UnderstandingRobustness Testing of Language Understanding in Task-Oriented Dialog
Most language understanding models in task-oriented dialog systems are trained on a small amount of annotated training data, and evaluated in a small set from the same distribution. However, these models can lead to syst…
Data AugmentationNatural Language UnderstandingAdaptive Natural Language Generation for Task-oriented Dialogue via Reinforcement Learning
When a natural language generation (NLG) component is implemented in a real-world task-oriented dialogue system, it is necessary to generate not only natural utterances as learned on training data but also utterances ada…
Natural Language Understandingreinforcement-learningReinforcement LearningReinforcement Learning (RL)+3TOD-BERT: Pre-trained Natural Language Understanding for Task-Oriented Dialogue
The underlying difference of linguistic patterns between general text and task-oriented dialogue makes existing pre-trained language models less useful in practice. In this work, we unify nine human-human and multi-turn …
Dialogue State TrackingIntent DetectionLanguage ModelingLanguage Modelling+2Multi-Task Learning of System Dialogue Act Selection for Supervised Pretraining of Goal-Oriented Dialogue Policies
This paper describes the use of Multi-Task Neural Networks (NNs) for system dialogue act selection. These models leverage the representations learned by the Natural Language Understanding (NLU) unit to enable robust init…
Multi-Task LearningNatural Language Understanding