Lessons from Contextual Bandit Learning in a Customer Support Bot
In this work, we describe practical lessons we have learned from successfully using contextual bandits (CBs) to improve key business metrics of the Microsoft Virtual Agent for customer support. While our current use cases focus on single step einforcement learning (RL) and mostly in the domain of natural language processing and information retrieval we believe many of our findings are generally applicable. Through this article, we highlight certain issues that RL practitioners may encounter in similar types of applications as well as offer practical solutions to these challenges.
Code (0)
등록된 구현이 없습니다.
Tasks
Information RetrievalMulti-Armed BanditsRecommendation SystemsRetrievalSimilar Papers 제목 키워드 기반
Contextual Bandit Applications in Customer Support Bot
Virtual support agents have grown in popularity as a way for businesses to provide better and more accessible customer service. Some challenges in this domain include ambiguous user queries as well as changing support to…
Multi-Armed BanditsAgentBuddy: A Contextual Bandit based Decision Support System for Customer Support Agents
In this short paper, we present early insights from a Decision Support System for Customer Support Agents (CSAs) serving customers of a leading accounting software. The system is under development and is designed to prov…
A Nonparametric Contextual Bandit with Arm-level Eligibility Control for Customer Service Routing
Amazon Customer Service provides real-time support for millions of customer contacts every year. While bot-resolver helps automate some traffic, we still see high demand for human agents, also called subject matter exper…
Thompson SamplingDistribution-free Contextual Dynamic Pricing
Contextual dynamic pricing aims to set personalized prices based on sequential interactions with customers. At each time period, a customer who is interested in purchasing a product comes to the platform. The customer's …
Online Residential Demand Response via Contextual Multi-Armed Bandits
Residential loads have great potential to enhance the efficiency and reliability of electricity systems via demand response (DR) programs. One major challenge in residential DR is to handle the unknown and uncertain cust…
Decision MakingMulti-Armed BanditsThompson Sampling