paper-with-me

홈 › Papers

Mitigating Strategy Preference Bias in Emotional Support Conversation via Uncertainty Estimations

2025-09-16 · Yougen Zhou, Qin Chen, Ningning Zhou, Jie Zhou, Xingjiao Wu, Liang He arxiv

Emotional support conversation (ESC) aims to alleviate distress through empathetic dialogue, yet large language models (LLMs) face persistent challenges in delivering effective ESC due to low accuracy in strategy planning. Moreover, there is a considerable preference bias towards specific strategies. Prior methods using fine-tuned strategy planners have shown potential in reducing such bias, while the underlying causes of the preference bias in LLMs have not well been studied. To address these issues, we first reveal the fundamental causes of the bias by identifying the knowledge boundaries of LLMs in strategy planning. Then, we propose an approach to mitigate the bias by reinforcement learning with a dual reward function, which optimizes strategy planning via both accuracy and entropy-based confidence for each region according to the knowledge boundaries. Experiments on the ESCov and ExTES datasets with multiple LLM backbones show that our approach outperforms the baselines, confirming the effectiveness of our approach.

📄 PDF Abstract BibTeX arXiv:2509.12661

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning

Similar Papers 제목 키워드 기반

Can Large Language Models be Good Emotional Supporter? Mitigating Preference Bias on Emotional Support Conversation

2024-02-20 · Dongjin Kang, Sunghwan Kim, Taeyoon Kwon, Seungjun Moon 외

Emotional Support Conversation (ESC) is a task aimed at alleviating individuals' emotional distress through daily conversation. Given its inherent complexity and non-intuitive nature, ESConv dataset incorporates support …

Emotional Intelligence

EmoDynamiX: Emotional Support Dialogue Strategy Prediction by Modelling MiXed Emotions and Discourse Dynamics

2024-08-16 · Chenwei Wan, Matthieu Labeau, Chloé Clavel

Designing emotionally intelligent conversational systems to provide comfort and advice to people experiencing distress is a compelling area of research. Recently, with advancements in large language models (LLMs), end-to…

Decision MakingEmotion RecognitionPredictionText Generation

DecoupledESC: Enhancing Emotional Support Generation via Strategy-Response Decoupled Preference Optimization

2025-05-22 · Chao Zhang, Xin Shi, Xueqiao Zhang, Yifan Zhu 외

Recent advances in Emotional Support Conversation (ESC) have improved emotional support generation by fine-tuning Large Language Models (LLMs) via Supervised Fine-Tuning (SFT). However, common psychological errors still …

Response Generation

Affective Flow Language Model for Emotional Support Conversation

2026-02-09 · Chenghui Zou, Ning Wang, Tiesunlong Shen, Luwei Xiao 외 arxiv

Large language models (LLMs) have been widely applied to emotional support conversation (ESC). However, complex multi-turn support remains challenging.This is because existing alignment schemes rely on sparse outcome-lev…

From Generic Empathy to Personalized Emotional Support: A Self-Evolution Framework for User Preference Alignment

2025-05-22 · Jing Ye, Lu Xiang, Yaping Zhang, Chengqing Zong

Effective emotional support hinges on understanding users' emotions and needs to provide meaningful comfort during multi-turn interactions. Large Language Models (LLMs) show great potential for expressing empathy; howeve…