paper-with-me

Papers

Harnessing the Power of Large Language Models for Empathetic Response Generation: Empirical Investigations and Improvements

2023-10-08 · Yushan Qian, Wei-Nan Zhang, Ting Liu

Empathetic dialogue is an indispensable part of building harmonious social relationships and contributes to the development of a helpful AI. Previous approaches are mainly based on fine small-scale language models. With the advent of ChatGPT, the application effect of large language models (LLMs) in this field has attracted great attention. This work empirically investigates the performance of LLMs in generating empathetic responses and proposes three improvement methods of semantically similar in-context learning, two-stage interactive generation, and combination with the knowledge base. Extensive experiments show that LLMs can significantly benefit from our proposed methods and is able to achieve state-of-the-art performance in both automatic and human evaluations. Additionally, we explore the possibility of GPT-4 simulating human evaluators.

📄 PDF Abstract BibTeX arXiv:2310.05140

Code (1)

27182812/LLM4ED 공식 구현 pytorch

Tasks

Empathetic Response GenerationIn-Context LearningResponse Generation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Position-Wise Feed-Forward Layer 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Adam 설명 없음

Similar Papers 제목 키워드 기반

Harnessing Large Language Models' Empathetic Response Generation Capabilities for Online Mental Health Counselling Support

2023-10-12 · Siyuan Brandon Loh, Aravind Sesagiri Raamkumar

Large Language Models (LLMs) have demonstrated remarkable performance across various information-seeking and reasoning tasks. These computational systems drive state-of-the-art dialogue systems, such as ChatGPT and Bard.…

Empathetic Response GenerationLanguage ModelingLanguage ModellingResponse Generation

Leveraging Chain of Thought towards Empathetic Spoken Dialogue without Corresponding Question-Answering Data

2025-01-19 · Jingran Xie, Shun Lei, Yue Yu, Yang Xiang 외

Empathetic dialogue is crucial for natural human-computer interaction, allowing the dialogue system to respond in a more personalized and emotionally aware manner, improving user satisfaction and engagement. The emergenc…

Dialogue GenerationQuestion Answering

ReflectDiffu:Reflect between Emotion-intent Contagion and Mimicry for Empathetic Response Generation via a RL-Diffusion Framework

2024-09-16 · Jiahao Yuan, Zixiang Di, Zhiqing Cui, Guisong Yang 외

Empathetic response generation necessitates the integration of emotional and intentional dynamics to foster meaningful interactions. Existing research either neglects the intricate interplay between emotion and intent, l…

Decision MakingDialogue GenerationEmotion RecognitionEmpathetic Response Generation+3

OpenS2S: Advancing Fully Open-Source End-to-End Empathetic Large Speech Language Model

2025-07-07 · Chen Wang, Tianyu Peng, Wen Yang, Yinan Bai 외 arxiv

Empathetic interaction is a cornerstone of human-machine communication, due to the need for understanding speech enriched with paralinguistic cues and generating emotional and expressive responses. However, the most powe…

CAiRE: An Empathetic Neural Chatbot

2019-07-28 · Zhaojiang Lin, Peng Xu, Genta Indra Winata, Farhad Bin Siddique 외

In this paper, we present an end-to-end empathetic conversation agent CAiRE. Our system adapts TransferTransfo (Wolf et al., 2019) learning approach that fine-tunes a large-scale pre-trained language model with multi-tas…

ChatbotEmpathetic Response GenerationLanguage ModelingLanguage Modelling+1