홈 › Papers

Ensemble-Based Deep Reinforcement Learning for Chatbots

2019-08-27 · Heriberto Cuayáhuitl, Donghyeon Lee, Seonghan Ryu, Yongjin Cho, Sungja Choi, Satish Indurthi, Seunghak Yu, Hyungtak Choi, Inchul Hwang, Jihie Kim

Trainable chatbots that exhibit fluent and human-like conversations remain a big challenge in artificial intelligence. Deep Reinforcement Learning (DRL) is promising for addressing this challenge, but its successful application remains an open question. This article describes a novel ensemble-based approach applied to value-based DRL chatbots, which use finite action sets as a form of meaning representation. In our approach, while dialogue actions are derived from sentence clustering, the training datasets in our ensemble are derived from dialogue clustering. The latter aim to induce specialised agents that learn to interact in a particular style. In order to facilitate neural chatbot training using our proposed approach, we assume dialogue data in raw text only -- without any manually-labelled data. Experimental results using chitchat data reveal that (1) near human-like dialogue policies can be induced, (2) generalisation to unseen data is a difficult problem, and (3) training an ensemble of chatbot agents is essential for improved performance over using a single agent. In addition to evaluations using held-out data, our results are further supported by a human evaluation that rated dialogues in terms of fluency, engagingness and consistency -- which revealed that our proposed dialogue rewards strongly correlate with human judgements.

📄 PDF Abstract BibTeX arXiv:1908.10422

Code (0)

등록된 구현이 없습니다.

Tasks

ChatbotClusteringDeep Reinforcement LearningOpen-Ended Question Answeringreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Sentence

CheerBots: Chatbots toward Empathy and Emotionusing Reinforcement Learning

2021-10-08 · Jiun-Hao Jhan, Chao-Peng Liu, Shyh-Kang Jeng, Hung-Yi Lee

Apart from the coherence and fluency of responses, an empathetic chatbot emphasizes more on people's feelings. By considering altruistic behaviors between human interaction, empathetic chatbots enable people to get a bet…

Chatbot Deep Reinforcement Learning reinforcement-learning Reinforcement Learning+2

Deep Reinforcement Learning for Chatbots Using Clustered Actions and Human-Likeness Rewards

2019-08-27 · Heriberto Cuayáhuitl, Donghyeon Lee, Seonghan Ryu, Sungja Choi 외

Training chatbots using the reinforcement learning paradigm is challenging due to high-dimensional states, infinite action spaces and the difficulty in specifying the reward function. We address such problems using clust…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+3

Distinguishing Scams and Fraud with Ensemble Learning

2024-12-11 · Isha Chadalavada, Tianhui Huang, Jessica Staddon

Users increasingly query LLM-enabled web chatbots for help with scam defense. The Consumer Financial Protection Bureau's complaints database is a rich data source for evaluating LLM performance on user scam queries, but …

Ensemble Learning

GoChat: Goal-oriented Chatbots with Hierarchical Reinforcement Learning

2020-05-24 · Jianfeng Liu, Feiyang Pan, Ling Luo

A chatbot that converses like a human should be goal-oriented (i.e., be purposeful in conversation), which is beyond language generation. However, existing dialogue systems often heavily rely on cumbersome hand-crafted r…

Chatbot Hierarchical Reinforcement Learning reinforcement-learning Reinforcement Learning+3

Towards Healthy AI: Large Language Models Need Therapists Too

2023-04-02 · Baihan Lin, Djallel Bouneffouf, Guillermo Cecchi, Kush R. Varshney

Recent advances in large language models (LLMs) have led to the development of powerful AI chatbots capable of engaging in natural and human-like conversations. However, these chatbots can be potentially harmful, exhibit…

Chatbot