PSentScore: Evaluating Sentiment Polarity in Dialogue Summarization
Automatic dialogue summarization is a well-established task with the goal of distilling the most crucial information from human conversations into concise textual summaries. However, most existing research has predominantly focused on summarizing factual information, neglecting the affective content, which can hold valuable insights for analyzing, monitoring, or facilitating human interactions. In this paper, we introduce and assess a set of measures PSentScore, aimed at quantifying the preservation of affective content in dialogue summaries. Our findings indicate that state-of-the-art summarization models do not preserve well the affective content within their summaries. Moreover, we demonstrate that a careful selection of the training set for dialogue samples can lead to improved preservation of affective content in the generated summaries, albeit with a minor reduction in content-related metrics.
Code (1)
Similar Papers 제목 키워드 기반
Using Customer Service Dialogues for Satisfaction Analysis with Context-Assisted Multiple Instance Learning
Customers ask questions and customer service staffs answer their questions, which is the basic service model via multi-turn customer service (CS) dialogues on E-commerce platforms. Existing studies fail to provide compre…
Multiple Instance LearningChinese Toxic Language Mitigation via Sentiment Polarity Consistent Rewrites
Detoxifying offensive language while preserving the speaker's original intent is a challenging yet critical goal for improving the quality of online interactions. Although large language models (LLMs) show promise in rew…
SentenceEnhancing General Sentiment Lexicons for Domain-Specific Use
Lexicon based methods for sentiment analysis rely on high quality polarity lexicons. In recent years, automatic methods for inducing lexicons have increased the viability of lexicon based methods for polarity classificat…
Domain Adaptationdomain classificationGeneral ClassificationSentiment Analysis+1Polarity Lexicon Building: to what Extent Is the Manual Effort Worth?
Polarity lexicons are a basic resource for analyzing the sentiments and opinions expressed in texts in an automated way. This paper explores three methods to construct polarity lexicons: translating existing lexicons fro…
Exploring Persona Sentiment Sensitivity in Personalized Dialogue Generation
Personalized dialogue systems have advanced considerably with the integration of user-specific personas into large language models (LLMs). However, while LLMs can effectively generate personalized responses, the influenc…
Dialogue GenerationSensitivity