A Practical 2-step Approach to Assist Enterprise Question-Answering Live Chat
Live chat in customer service platforms is critical for serving clients online. For multi-turn question-answering live chat, typical Question Answering systems are single-turn and focus on factoid questions; alternatively, modeling as goal-oriented dialogue limits us to narrower domains. Motivated by these challenges, we develop a new approach based on a framework from a different discipline: Community Question Answering. Specifically, we opt to divide and conquer the task into two sub-tasks: (1) Question-Question Similarity, where we gain more than 9% absolute improvement in F1 over baseline; and (2) Answer Utterances Extraction, where we achieve a high F1 score of 87% for this new sub-task. Further, our user engagement metrics reveal how the enterprise support representatives benefit from the 2-step approach we deployed to production.
Code (0)
등록된 구현이 없습니다.
Tasks
Community Question AnsweringQuestion AnsweringQuestion SimilarityMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Hi, how can I help you?: Automating enterprise IT support help desks
Question answering is one of the primary challenges of natural language understanding. In realizing such a system, providing complex long answers to questions is a challenging task as opposed to factoid answering as the …
ManagementNatural Language UnderstandingQuestion AnsweringRetrievalA Benchmark to Understand the Role of Knowledge Graphs on Large Language Model's Accuracy for Question Answering on Enterprise SQL Databases
Enterprise applications of Large Language Models (LLMs) hold promise for question answering on enterprise SQL databases. However, the extent to which LLMs can accurately respond to enterprise questions in such databases …
Knowledge GraphsQuestion AnsweringText to SQLText-To-SQLFrom Search to Reasoning: A Five-Level RAG Capability Framework for Enterprise Data
Retrieval-Augmented Generation (RAG) has emerged as the standard paradigm for answering questions on enterprise data. Traditionally, RAG has centered on text-based semantic search and re-ranking. However, this approach f…
Question AnsweringEnhancing Discoverability in Enterprise Conversational Systems with Proactive Question Suggestions
Enterprise conversational AI systems are becoming increasingly popular to assist users in completing daily tasks such as those in marketing and customer management. However, new users often struggle to ask effective ques…
ManagementMarketingQuestion GenerationQuestion-GenerationMind the Boundary: Stabilizing Gemini Enterprise A2A via a Cloud Run Hub Across Projects and Accounts
Enterprise conversational UIs increasingly need to orchestrate heterogeneous backend agents and tools across project and account boundaries in a secure and reproducible way. Starting from Gemini Enterprise Agent-to-Agent…
Question AnsweringGeneral Knowledge