Incremental Summarization for Customer Support via Progressive Note-Taking and Agent Feedback
We introduce an incremental summarization system for customer support agents that intelligently determines when to generate concise bullet notes during conversations, reducing agents' context-switching effort and redundant review. Our approach combines a fine-tuned Mixtral-8x7B model for continuous note generation with a DeBERTa-based classifier to filter trivial content. Agent edits refine the online notes generation and regularly inform offline model retraining, closing the agent edits feedback loop. Deployed in production, our system achieved a 3% reduction in case handling time compared to bulk summarization (with reductions of up to 9% in highly complex cases), alongside high agent satisfaction ratings from surveys. These results demonstrate that incremental summarization with continuous feedback effectively enhances summary quality and agent productivity at scale.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
TWEETSUMM - A Dialog Summarization Dataset for Customer Service
In a typical customer service chat scenario, customers contact a support center to ask for help or raise complaints, and human agents try to solve the issues. In most cases, at the end of the conversation, agents are ask…
Extractive SummarizationUnsupervised Extractive SummarizationTWEETSUMM -- A Dialog Summarization Dataset for Customer Service
In a typical customer service chat scenario, customers contact a support center to ask for help or raise complaints, and human agents try to solve the issues. In most cases, at the end of the conversation, agents are ask…
Extractive SummarizationUnsupervised Extractive SummarizationIncremental Extractive Opinion Summarization Using Cover Trees
Extractive opinion summarization involves automatically producing a summary of text about an entity (e.g., a product's reviews) by extracting representative sentences that capture prevalent opinions in the review set. Ty…
Extractive SummarizationOpinion SummarizationHeuristic-based Inter-training to Improve Few-shot Multi-perspective Dialog Summarization
Many organizations require their customer-care agents to manually summarize their conversations with customers. These summaries are vital for decision making purposes of the organizations. The perspective of the summary …
Decision MakingUtilizing Large Language Models for Automating Technical Customer Support
The use of large language models (LLMs) such as OpenAI's GPT-4 in technical customer support (TCS) has the potential to revolutionize this area. This study examines automated text correction, summarization of customer in…
Question Answering