paper-with-me

Papers

One Chatbot Per Person: Creating Personalized Chatbots based on Implicit User Profiles

2021-08-20 · Zhengyi Ma, Zhicheng Dou, Yutao Zhu, Hanxun Zhong, Ji-Rong Wen

Personalized chatbots focus on endowing chatbots with a consistent personality to behave like real users, give more informative responses, and further act as personal assistants. Existing personalized approaches tried to incorporate several text descriptions as explicit user profiles. However, the acquisition of such explicit profiles is expensive and time-consuming, thus being impractical for large-scale real-world applications. Moreover, the restricted predefined profile neglects the language behavior of a real user and cannot be automatically updated together with the change of user interests. In this paper, we propose to learn implicit user profiles automatically from large-scale user dialogue history for building personalized chatbots. Specifically, leveraging the benefits of Transformer on language understanding, we train a personalized language model to construct a general user profile from the user's historical responses. To highlight the relevant historical responses to the input post, we further establish a key-value memory network of historical post-response pairs, and build a dynamic post-aware user profile. The dynamic profile mainly describes what and how the user has responded to similar posts in history. To explicitly utilize users' frequently used words, we design a personalized decoder to fuse two decoding strategies, including generating a word from the generic vocabulary and copying one word from the user's personalized vocabulary. Experiments on two real-world datasets show the significant improvement of our model compared with existing methods. Our code is available at https://github.com/zhengyima/DHAP

📄 PDF Abstract BibTeX arXiv:2108.09355

Code (1)

zhengyima/dhap 공식 구현 pytorch

Tasks

ChatbotLanguage Modelling

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Adam 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Similar Papers 제목 키워드 기반

MCP: Self-supervised Pre-training for Personalized Chatbots with Multi-level Contrastive Sampling

2022-10-17 · Zhaoheng Huang, Zhicheng Dou, Yutao Zhu, Zhengyi Ma

Personalized chatbots focus on endowing the chatbots with a consistent personality to behave like real users and further act as personal assistants. Previous studies have explored generating implicit user profiles from t…

Response GenerationSelf-Supervised Learning

Learning Implicit User Profiles for Personalized Retrieval-Based Chatbot

2021-08-18 · Hongjin Qian, Zhicheng Dou, Yutao Zhu, Yueyuan Ma 외

In this paper, we explore the problem of developing personalized chatbots. A personalized chatbot is designed as a digital chatting assistant for a user. The key characteristic of a personalized chatbot is that it should…

ChatbotRetrieval

Navigating the Unknown: A Chat-Based Collaborative Interface for Personalized Exploratory Tasks

2024-10-31 · Yingzhe Peng, Xiaoting Qin, Zhiyang Zhang, Jue Zhang 외

The rise of large language models (LLMs) has revolutionized user interactions with knowledge-based systems, enabling chatbots to synthesize vast amounts of information and assist with complex, exploratory tasks. However,…

Chatbot

Investigating person-specific errors in chat-oriented dialogue systems

2022-05-01 · ACL 2022 5 · Koh Mitsuda, Ryuichiro Higashinaka, Tingxuan Li, Sen Yoshida

Creating chatbots to behave like real people is important in terms of believability. Errors in general chatbots and chatbots that follow a rough persona have been studied, but those in chatbots that behave like real peop…

Chatbot

Creation Of A ChatBot Based On Natural Language Proccesing For Whatsapp

2023-10-10 · Valderrama Jonatan, Aguilar-Alonso Igor

In the era of digital transformation, customer service is of paramount importance to the success of organizations, and to meet the growing demand for immediate responses and personalized assistance 24 hours a day, chatbo…

ChatbotNatural Language Understanding