Chat or Learn: a Data-Driven Robust Question-Answering System
We present a voice-based conversational agent which combines the robustness of chatbots and the utility of question answering (QA) systems. Indeed, while data-driven chatbots are typically user-friendly but not goal-oriented, QA systems tend to perform poorly at chitchat. The proposed chatbot relies on a controller which performs dialogue act classification and feeds user input either to a sequence-to-sequence chatbot or to a QA system. The resulting chatbot is a spoken QA application for the Google Home smart speaker. The system is endowed with general-domain knowledge from Wikipedia articles and uses coreference resolution to detect relatedness between questions. We present our choices of data sets for training and testing the components, and present the experimental results that helped us optimize the parameters of the chatbot. In particular, we discuss the appropriateness of using the SQuAD dataset for evaluating end-to-end QA, in the light of our system{'}s behavior.
Code (0)
등록된 구현이 없습니다.
Tasks
ArticlesChatbotcoreference-resolutionCoreference ResolutionDialogue Act ClassificationQuestion AnsweringSimilar Papers 제목 키워드 기반
Can ChatGPT Replace Traditional KBQA Models? An In-depth Analysis of the Question Answering Performance of the GPT LLM Family
ChatGPT is a powerful large language model (LLM) that covers knowledge resources such as Wikipedia and supports natural language question answering using its own knowledge. Therefore, there is growing interest in explori…
Knowledge Base Question AnsweringLanguage ModelingLanguage ModellingLarge Language Model+3ChatGPT is a Knowledgeable but Inexperienced Solver: An Investigation of Commonsense Problem in Large Language Models
Large language models (LLMs) have made significant progress in NLP. However, their ability to memorize, represent, and leverage commonsense knowledge has been a well-known pain point. In this paper, we specifically focus…
Instruction FollowingA Practical 2-step Approach to Assist Enterprise Question-Answering Live Chat
Live chat in customer service platforms is critical for serving clients online. For multi-turn question-answering live chat, typical Question Answering systems are single-turn and focus on factoid questions; alternativel…
Community Question AnsweringQuestion AnsweringQuestion SimilarityEvaluating ChatGPT as a Question Answering System: A Comprehensive Analysis and Comparison with Existing Models
In the current era, a multitude of language models has emerged to cater to user inquiries. Notably, the GPT-3.5 Turbo language model has gained substantial attention as the underlying technology for ChatGPT. Leveraging e…
HallucinationLanguage ModellingPrompt EngineeringQuestion AnsweringIn-Context Learning for Knowledge Base Question Answering for Unmanned Systems based on Large Language Models
Knowledge Base Question Answering (KBQA) aims to answer factoid questions based on knowledge bases. However, generating the most appropriate knowledge base query code based on Natural Language Questions (NLQ) poses a sig…
In-Context LearningKnowledge Base Question AnsweringProper NounQuestion Answering