Data Query Language and Corpus Tools for Slot-Filling and Intent Classification Data
Typical machine learning approaches to developing task-oriented dialog systems require the collection and management of large amounts of training data, especially for the tasks of intent classification and slot-filling. Managing this data can be cumbersome without dedicated tools to help the dialog system designer understand the nature of the data. This paper presents a toolkit for analyzing slot-filling and intent classification corpora. We present a toolkit that includes (1) a new lightweight and readable data and file format for intent classification and slot-filling corpora, (2) a new query language for searching intent classification and slot-filling corpora, and (3) tools for understanding the structure and makeup for such corpora. We apply our toolkit to several well-known NLU datasets, and demonstrate that our toolkit can be used to uncover interesting and surprising insights. By releasing our toolkit to the research community, we hope to enable others to develop more robust and intelligent slot-filling and intent classification models.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationGeneral Classificationintent-classificationIntent ClassificationIntent Classification and Slot FillingManagementslot-fillingSlot FillingSimilar Papers 제목 키워드 기반
To Boldly Query What No One Has Annotated Before? The Frontiers of Corpus Querying
Corpus query systems exist to address the multifarious information needs of any person interested in the content of annotated corpora. In this role they play an important part in making those resources usable for a wider…
Source Critical Reinforcement Learning for Transferring Spoken Language Understanding to a New Language
To deploy a spoken language understanding (SLU) model to a new language, language transferring is desired to avoid the trouble of acquiring and labeling a new big SLU corpus. An SLU corpus is a monolingual corpus with do…
Cultural Vocal Bursts Intensity Predictiondomain classificationGeneral ClassificationMachine Translation+7End-to-End Slot Alignment and Recognition for Cross-Lingual NLU
Natural language understanding (NLU) in the context of goal-oriented dialog systems typically includes intent classification and slot labeling tasks. Existing methods to expand an NLU system to new languages use machine …
Cross-Lingual TransferGoal-Oriented Dialogintent-classificationIntent Classification+4Source-Critical Reinforcement Learning for Transferring Spoken Language Understanding to a New Language
To deploy a spoken language understanding (SLU) model to a new language, language transferring is desired to avoid the trouble of acquiring and labeling a new big SLU corpus. Translating the original SLU corpus into the …
Cultural Vocal Bursts Intensity Predictiondomain classificationGeneral Classificationreinforcement-learning+5The Corpus Query Middleware of Tomorrow -- A Proposal for a Hybrid Corpus Query Architecture
Development of dozens of specialized corpus query systems and languages over the past decades has let to a diverse but also fragmented landscape. Today we are faced with a plethora of query tools that each provide unique…