paper-with-me

홈 › Papers

Which Channel to Ask My Question? Personalized Customer Service RequestStream Routing using DeepReinforcement Learning

2019-11-24 · Zining Liu, Chong Long, Xiaolu Lu, Zehong Hu, Jie Zhang, Yafang Wang

Customer services are critical to all companies, as they may directly connect to the brand reputation. Due to a great number of customers, e-commerce companies often employ multiple communication channels to answer customers' questions, for example, chatbot and hotline. On one hand, each channel has limited capacity to respond to customers' requests, on the other hand, customers have different preferences over these channels. The current production systems are mainly built based on business rules, which merely considers tradeoffs between resources and customers' satisfaction. To achieve the optimal tradeoff between resources and customers' satisfaction, we propose a new framework based on deep reinforcement learning, which directly takes both resources and user model into account. In addition to the framework, we also propose a new deep-reinforcement-learning based routing method-double dueling deep Q-learning with prioritized experience replay (PER-DoDDQN). We evaluate our proposed framework and method using both synthetic and a real customer service log data from a large financial technology company. We show that our proposed deep-reinforcement-learning based framework is superior to the existing production system. Moreover, we also show our proposed PER-DoDDQN is better than all other deep Q-learning variants in practice, which provides a more optimal routing plan. These observations suggest that our proposed method can seek the trade-off where both channel resources and customers' satisfaction are optimal.

📄 PDF Abstract BibTeX arXiv:1911.10521

Code (0)

등록된 구현이 없습니다.

Tasks

ChatbotDeep Reinforcement LearningQ-Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Prioritized Experience Replay Prioritized Experience Replay is a type of experience replay in reinforcement learning where we more frequently replay…
Experience Replay Experience Replay is a replay memory technique used in reinforcement learning where we store the agent’s experiences at each time-step, $e\_{t} = \left(s\_{t}, a\_{t}, r\_{t},…
Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Similar Papers 제목 키워드 기반

Automating Customer Service using LangChain: Building custom open-source GPT Chatbot for organizations

2023-10-09 · Keivalya Pandya, Mehfuza Holia

In the digital age, the dynamics of customer service are evolving, driven by technological advancements and the integration of Large Language Models (LLMs). This research paper introduces a groundbreaking approach to aut…

Chatbot

A Two-stage Attention-based Model for Customer Satisfaction Prediction in E-commerce Customer Service

2022-01-16 · ACL ARR January 2022 1 · Anonymous

Nowadays, customer satisfaction prediction (CSP) on e-commerce platforms has become a hot research topic for both intelligent customer service and artificial customer service. CSP aims to discover customer satisfaction a…

Data Driven Content Creation using Statistical and Natural Language Processing Techniques for Financial Domain

2021-09-07 · FNP 2021 9 · Ankush Chopra, Prateek Nagwanshi, Sohom Ghosh

Over the years customers' expectation of getting information instantaneously has given rise to the increased usage of channels like virtual assistants. Typically, customers try to get their questions answered by low-touc…

Semantic SimilaritySemantic Textual Similarity

Hybrid Intent-Aware Personalization with Machine Learning and RAG-Enabled Large Language Models for Financial Services Marketing

2026-03-11 · Akhil Chandra Shanivendra arxiv

Personalized marketing in financial services requires models that can both predict customer behavior and generate compliant, context-appropriate content. This paper presents a hybrid architecture that integrates classica…

An Emotional Comfort Framework for Improving User Satisfaction in E-Commerce Customer Service Chatbots

2021-06-01 · NAACL 2021 4 · Shuangyong Song, Chao Wang, Haiqing Chen, Huan Chen

E-commerce has grown substantially over the last several years, and chatbots for intelligent customer service are concurrently drawing attention. We presented AliMe Assist, a Chinese intelligent assistant designed for cr…

Answer SelectionEmotion ClassificationQuestion AnsweringText Matching+1