Unified Knowledge Prompt Pre-training for Customer Service Dialogues
Dialogue bots have been widely applied in customer service scenarios to provide timely and user-friendly experience. These bots must classify the appropriate domain of a dialogue, understand the intent of users, and generate proper responses. Existing dialogue pre-training models are designed only for several dialogue tasks and ignore weakly-supervised expert knowledge in customer service dialogues. In this paper, we propose a novel unified knowledge prompt pre-training framework, UFA (\textbf{U}nified Model \textbf{F}or \textbf{A}ll Tasks), for customer service dialogues. We formulate all the tasks of customer service dialogues as a unified text-to-text generation task and introduce a knowledge-driven prompt strategy to jointly learn from a mixture of distinct dialogue tasks. We pre-train UFA on a large-scale Chinese customer service corpus collected from practical scenarios and get significant improvements on both natural language understanding (NLU) and natural language generation (NLG) benchmarks.
Code (0)
등록된 구현이 없습니다.
Tasks
Natural Language UnderstandingText GenerationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
AdaCoach: A Virtual Coach for Training Customer Service Agents
With the development of online business, customer service agents gradually play a crucial role as an interface between the companies and their customers. Most companies spend a lot of time and effort on hiring and traini…
Dialogue EvaluationThe economic trade-offs of large language models: A case study
Contacting customer service via chat is a common practice. Because employing customer service agents is expensive, many companies are turning to NLP that assists human agents by auto-generating responses that can be used…
Knowledge DistillationPrompt EngineeringExpanding Chatbot Knowledge in Customer Service: Context-Aware Similar Question Generation Using Large Language Models
Reliable responses of service chatbots are often achieved by employing retrieval-based methods that restrict answers to a knowledge base comprising predefined question-answer pairs (QA pairs). To accommodate potential va…
ChatbotDiversityNatural Language UnderstandingQuestion Generation+1Using Advanced LLMs to Enhance Smaller LLMs: An Interpretable Knowledge Distillation Approach
Advanced Large language models (LLMs) like GPT-4 or LlaMa 3 provide superior performance in complex human-like interactions. But they are costly, or too large for edge devices such as smartphones and harder to self-host,…
Knowledge DistillationSimulating Ride-Pooling Services with Pre-Booking and On-Demand Customers
If private vehicle trips can be replaced, ride-pooling services can decrease parking space needed by higher vehicle utilization and increase traffic efficiency by increasing vehicle occupancy. Nevertheless, substantial b…