Elastic CRFs for Open-ontology Slot Filling
Slot filling is a crucial component in task-oriented dialog systems that is used to parse (user) utterances into semantic concepts called slots. An ontology is defined by the collection of slots and the values that each slot can take. The most widely used practice of treating slot filling as a sequence labeling task suffers from two main drawbacks. First, the ontology is usually pre-defined and fixed and therefore is not able to detect new labels for unseen slots. Second, the one-hot encoding of slot labels ignores the correlations between slots with similar semantics, which makes it difficult to share knowledge learned across different domains. To address these problems, we propose a new model called elastic conditional random field (eCRF), where each slot is represented by the embedding of its natural language description and modeled by a CRF layer. New slot values can be detected by eCRF whenever a language description is available for the slot. In our experiment, we show that eCRFs outperform existing models in both in-domain and cross-domain tasks, especially in predicting unseen slots and values.
Code (0)
등록된 구현이 없습니다.
Tasks
slot-fillingSlot FillingSimilar Papers 제목 키워드 기반
Ontology-Enhanced Slot Filling
Slot filling is a fundamental task in dialog state tracking in task-oriented dialog systems. In multi-domain task-oriented dialog system, user utterances and system responses may mention multiple named entities and attri…
dialog state trackingGPUslot-fillingSlot FillingSANTO: A Web-based Annotation Tool for Ontology-driven Slot Filling
Supervised machine learning algorithms require training data whose generation for complex relation extraction tasks tends to be difficult. Being optimized for relation extraction at sentence level, many annotation tools …
Knowledge Base PopulationReading ComprehensionRelationRelation Extraction+3Hyponymy extraction of domain ontology concept based on ccrfs and hierarchy clustering
Concept hierarchy is the backbone of ontology, and the concept hierarchy acquisition has been a hot topic in the field of ontology learning. this paper proposes a hyponymy extraction method of domain ontology concept bas…
ClusteringSlot Filling for Extracting Reskilling and Upskilling Options from the Web
Disturbances in the job market such as advances in science and technology, crisis and increased competition have triggered a surge in reskilling and upskilling programs. Information on suitable continuing education optio…
BenchmarkingEntity Linkingslot-fillingSlot FillingAdversarial Semantic Decoupling for Recognizing Open-Vocabulary Slots
Open-vocabulary slots, such as file name, album name, or schedule title, significantly degrade the performance of neural-based slot filling models since these slots can take on values from a virtually unlimited set and h…
Sentenceslot-fillingSlot Filling