paper-with-me

Papers

Generative Adversarial Imitation Learning for Empathy-based AI

2021-05-27 · Pratyush Muthukumar, Karishma Muthukumar, Deepan Muthirayan, Pramod Khargonekar

Generative adversarial imitation learning (GAIL) is a model-free algorithm that has been shown to provide strong results in imitating complex behaviors in high-dimensional environments. In this paper, we utilize the GAIL model for text generation to develop empathy-based context-aware conversational AI. Our model uses an expert trajectory of empathetic prompt-response dialogues which can accurately exhibit the correct empathetic emotion when generating a response. The Generator of the GAIL model uses the GPT-2 sequential pre-trained language model trained on 117 million parameters from 40 GB of internet data. We propose a novel application of an approach used in transfer learning to fine tune the GPT-2 model in order to generate concise, user-specific empathetic responses validated against the Discriminator. Our novel GAIL model utilizes a sentiment analysis history-based reinforcement learning approach to empathetically respond to human interactions in a personalized manner. We find that our model's response scores on various human-generated prompts collected from the Facebook Empathetic Dialogues dataset outperform baseline counterparts. Moreover, our model improves upon various history-based conversational AI models developed recently, as our model's performance over a sustained conversation of 3 or more interactions outperform similar conversational AI models.

📄 PDF Abstract BibTeX arXiv:2105.13328

Code (0)

등록된 구현이 없습니다.

Tasks

Imitation LearningLanguage ModellingSentiment AnalysisText GenerationTransfer Learning

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Residual Connection 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…

Similar Papers 제목 키워드 기반

Generating Proto-Personas through Prompt Engineering: A Case Study on Efficiency, Effectiveness and Empathy

2025-07-11 · Fernando Ayach, Vitor Lameirão, Raul Leão, Jerfferson Felizardo 외 arxiv

Proto-personas are commonly used during early-stage Product Discovery, such as Lean Inception, to guide product definition and stakeholder alignment. However, the manual creation of proto-personas is often time-consuming…

Prompt Engineering

Reflecting Twice before Speaking with Empathy: Self-Reflective Alternating Inference for Empathy-Aware End-to-End Spoken Dialogue

2026-01-26 · Yuhang Jia, Pei Liu, Haoqin Sun, Jiaming Zhou 외 arxiv

End-to-end Spoken Language Models (SLMs) hold great potential for paralinguistic perception, and numerous studies have aimed to enhance their capabilities, particularly for empathetic dialogue. However, current approache…

Reinforcement LearningResponse Generation

Modeling Empathy and Distress in Reaction to News Stories

2018-08-30 · EMNLP 2018 10 · Sven Buechel, Anneke Buffone, Barry Slaff, Lyle Ungar 외

Computational detection and understanding of empathy is an important factor in advancing human-computer interaction. Yet to date, text-based empathy prediction has the following major limitations: It underestimates the p…

BEAM: Brainwave Empathy Assessment Model for Early Childhood

2025-09-08 · Chen Xie, Gaofeng Wu, Kaidong Wang, Zihao Zhu 외 arxiv

Empathy in young children is crucial for their social and emotional development, yet predicting it remains challenging. Traditional methods often only rely on self-reports or observer-based labeling, which are susceptibl…

Contrastive Learning

Empathy-driven Arabic Conversational Chatbot

2020-12-01 · COLING (WANLP) 2020 12 · Tarek Naous, Christian Hokayem, Hazem Hajj

Conversational models have witnessed a significant research interest in the last few years with the advancements in sequence generation models. A challenging aspect in developing human-like conversational models is enabl…

ChatbotDecoder