Novel Slot Detection: A Benchmark for Discovering Unknown Slot Types in the Task-Oriented Dialogue System
Existing slot filling models can only recognize pre-defined in-domain slot types from a limited slot set. In the practical application, a reliable dialogue system should know what it does not know. In this paper, we introduce a new task, Novel Slot Detection (NSD), in the task-oriented dialogue system. NSD aims to discover unknown or out-of-domain slot types to strengthen the capability of a dialogue system based on in-domain training data. Besides, we construct two public NSD datasets, propose several strong NSD baselines, and establish a benchmark for future work. Finally, we conduct exhaustive experiments and qualitative analysis to comprehend key challenges and provide new guidance for future directions.
Code (1)
Tasks
slot-fillingSlot FillingSimilar Papers 제목 키워드 기반
Modeling with Recurrent Neural Networks for Open Vocabulary Slots
Dealing with {`}open-vocabulary{'} slots has been among the challenges in the natural language area. While recent studies on attention-based recurrent neural network (RNN) models have performed well in completing several…
Goal-Oriented Dialogue SystemsIntent DetectionLanguage ModelingLanguage Modelling+6OpenSlot: Mixed Open-Set Recognition with Object-Centric Learning
Existing open-set recognition (OSR) studies typically assume that each image contains only one class label, with the unknown test set (negative) having a disjoint label space from the known test set (positive), a scenari…
Computational Efficiencyobject-detectionObject DetectionOpen Set LearningSTN4DST: A Scalable Dialogue State Tracking based on Slot Tagging Navigation
Scalability for handling unknown slot values is a important problem in dialogue state tracking (DST). As far as we know, previous scalable DST approaches generally rely on either the candidate generation from slot taggin…
Dialogue State TrackingPositionContext-Sensitive Generation Network for Handing Unknown Slot Values in Dialogue State Tracking
As a key component in a dialogue system, dialogue state tracking plays an important role. It is very important for dialogue state tracking to deal with the problem of unknown slot values. As far as we known, almost all e…
Dialogue State TrackingDiscovering Dialogue Slots with Weak Supervision
Task-oriented dialogue systems typically require manual annotation of dialogue slots in training data, which is costly to obtain. We propose a method that eliminates this requirement: We use weak supervision from existin…
Response GenerationTask-Oriented Dialogue Systems