Task Oriented Conversational Modelling With Subjective Knowledge
Existing conversational models are handled by a database(DB) and API based systems. However, very often users' questions require information that cannot be handled by such systems. Nonetheless, answers to these questions are available in the form of customer reviews and FAQs. DSTC-11 proposes a three stage pipeline consisting of knowledge seeking turn detection, knowledge selection and response generation to create a conversational model grounded on this subjective knowledge. In this paper, we focus on improving the knowledge selection module to enhance the overall system performance. In particular, we propose entity retrieval methods which result in an accurate and faster knowledge search. Our proposed Named Entity Recognition (NER) based entity retrieval method results in 7X faster search compared to the baseline model. Additionally, we also explore a potential keyword extraction method which can improve the accuracy of knowledge selection. Preliminary results show a 4 \% improvement in exact match score on knowledge selection task. The code is available https://github.com/raja-kumar/knowledge-grounded-TODS
Code (1)
Tasks
Entity RetrievalKeyword Extractionnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERResponse GenerationRetrievalSimilar Papers 제목 키워드 기반
Leveraging Few-Shot Data Augmentation and Waterfall Prompting for Response Generation
This paper discusses our approaches for task-oriented conversational modelling using subjective knowledge, with a particular emphasis on response generation. Our methodology was shaped by an extensive data analysis that …
Data AugmentationFew-Shot LearningResponse Generation"What do others think?": Task-Oriented Conversational Modeling with Subjective Knowledge
Task-oriented Dialogue (TOD) Systems aim to build dialogue systems that assist users in accomplishing specific goals, such as booking a hotel or a restaurant. Traditional TODs rely on domain-specific APIs/DBs or external…
Contrastive Response Pairs for Automatic Evaluation of Non-task-oriented Neural Conversational Models
Responses generated by neural conversational models (NCMs) for non-task-oriented systems are difficult to evaluate. We propose contrastive response pairs (CRPs) for automatically evaluating responses from non-task-orient…
DecoderBeyond Domain APIs: Task-oriented Conversational Modeling with Unstructured Knowledge Access
Most prior work on task-oriented dialogue systems are restricted to a limited coverage of domain APIs, while users oftentimes have domain related requests that are not covered by the APIs. In this paper, we propose to ex…
Response GenerationTask-Oriented Dialogue SystemsTraining Neural Response Selection for Task-Oriented Dialogue Systems
Despite their popularity in the chatbot literature, retrieval-based models have had modest impact on task-oriented dialogue systems, with the main obstacle to their application being the low-data regime of most task-orie…
ChatbotLanguage ModellingRetrievalTask-Oriented Dialogue Systems