Customer Sentiment Analysis using Weak Supervision for Customer-Agent Chat
Prior work on sentiment analysis using weak supervision primarily focuses on different reviews such as movies (IMDB), restaurants (Yelp), products (Amazon).~One under-explored field in this regard is customer chat data for a customer-agent chat in customer support due to the lack of availability of free public data. Here, we perform sentiment analysis on customer chat using weak supervision on our in-house dataset. We fine-tune the pre-trained language model (LM) RoBERTa as a sentiment classifier using weak supervision. Our contribution is as follows:1) We show that by using weak sentiment classifiers along with domain-specific lexicon-based rules as Labeling Functions (LF), we can train a fairly accurate customer chat sentiment classifier using weak supervision. 2) We compare the performance of our custom-trained model with off-the-shelf google cloud NLP API for sentiment analysis. We show that by injecting domain-specific knowledge using LFs, even with weak supervision, we can train a model to handle some domain-specific use cases better than off-the-shelf google cloud NLP API. 3) We also present an analysis of how customer sentiment in a chat relates to problem resolution.
Code (0)
등록된 구현이 없습니다.
Tasks
Language ModelingLanguage ModellingSentiment AnalysisMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A Comparison of Indonesia E-Commerce Sentiment Analysis for Marketing Intelligence Effort
The rapid growth of the e-commerce market in Indonesia, making various e-commerce companies appear and there has been high competition among them. Marketing intelligence is an important activity to measure competitive po…
MarketingSentiment AnalysisWhat sentiment analysis can't see: Measuring whether customers were helped, and what went wrong, across 70,000 support conversations
Most companies read their customer support data at scale using sentiment analysis, which measures how customers sound rather than whether they were satisfied with the result. We tested a richer alternative on 70,450 supp…
Sentiment AnalysisCan a Humanoid Robot be part of the Organizational Workforce? A User Study Leveraging Sentiment Analysis
Hiring robots for the workplaces is a challenging task as robots have to cater to customer demands, follow organizational protocols and behave with social etiquette. In this study, we propose to have a humanoid social ro…
Aspect ExtractionSentiment AnalysisUsing Customer Service Dialogues for Satisfaction Analysis with Context-Assisted Multiple Instance Learning
Customers ask questions and customer service staffs answer their questions, which is the basic service model via multi-turn customer service (CS) dialogues on E-commerce platforms. Existing studies fail to provide compre…
Multiple Instance LearningPoliSe: Reinforcing Politeness using User Sentiment for Customer Care Response Generation
The interaction between a consumer and the customer service representative greatly contributes to the overall customer experience. Therefore, to ensure customers' comfort and retention, it is important that customer serv…
DecoderResponse GenerationSentiment Analysis