Type-aware Convolutional Neural Networks for Slot Filling
The slot filling task aims at extracting answers for queries about entities from text, such as "Who founded Apple". In this paper, we focus on the relation classification component of a slot filling system. We propose type-aware convolutional neural networks to benefit from the mutual dependencies between entity and relation classification. In particular, we explore different ways of integrating the named entity types of the relation arguments into a neural network for relation classification, including a joint training and a structured prediction approach. To the best of our knowledge, this is the first study on type-aware neural networks for slot filling. The type-aware models lead to the best results of our slot filling pipeline. Joint training performs comparable to structured prediction. To understand the impact of the different components of the slot filling pipeline, we perform a recall analysis, a manual error analysis and several ablation studies. Such analyses are of particular importance to other slot filling researchers since the official slot filling evaluations only assess pipeline outputs. The analyses show that especially coreference resolution and our convolutional neural networks have a large positive impact on the final performance of the slot filling pipeline. The presented models, the source code of our system as well as our coreference resource is publicy available.
Code (0)
등록된 구현이 없습니다.
Tasks
coreference-resolutionCoreference ResolutionGeneral ClassificationRelationRelation Classificationslot-fillingSlot FillingStructured PredictionVocal Bursts Type PredictionSimilar Papers 제목 키워드 기반
Explainable Slot Type Attentions to Improve Joint Intent Detection and Slot Filling
Joint intent detection and slot filling is a key research topic in natural language understanding (NLU). Existing joint intent and slot filling systems analyze and compute features collectively for all slot types, and im…
Intent DetectionNatural Language Understandingslot-fillingSlot FillingLinguistically-Enriched and Context-Aware Zero-shot Slot Filling
Slot filling is identifying contiguous spans of words in an utterance that correspond to certain parameters (i.e., slots) of a user request/query. Slot filling is one of the most important challenges in modern task-orien…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)slot-filling+2HierarchicalContrast: A Coarse-to-Fine Contrastive Learning Framework for Cross-Domain Zero-Shot Slot Filling
In task-oriented dialogue scenarios, cross-domain zero-shot slot filling plays a vital role in leveraging source domain knowledge to learn a model with high generalization ability in unknown target domain where annotated…
Contrastive Learningslot-fillingSlot FillingTransfer Learning+1AISFG: Abundant Information Slot Filling Generator
As an essential component of task-oriented dialogue systems, slot filling requires enormous labeled training data in a certain domain. However, in most cases, there is little or no target domain training data is availabl…
Few-Shot Learningslot-fillingSlot FillingTask-Oriented Dialogue SystemsQA-Driven Zero-shot Slot Filling with Weak Supervision Pretraining
Slot-filling is an essential component for building task-oriented dialog systems. In this work, we focus on the zero-shot slot-filling problem, where the model needs to predict slots and their values, given utterances fr…
slot-fillingSlot FillingZero-shot Slot Filling