paper-with-me

홈 › Papers

Learning to Acquire Knowledge from a Search Engine for Dialogue Response Generation

2021-10-16 · ACL ARR October 2021 10 · Anonymous

Knowledge-aided dialogue response generation aims at augmenting chatbots with relevant external knowledge in the hope of generating more informative responses. The majority of previous work assumes that the relevant knowledge is given as input or retrieved from a static pool of knowledge. However, this assumption violates the real-world situation, where knowledge is continually updated and a chatbot has to \emph{dynamically} retrieve useful knowledge. In this paper, we propose a dialogue model that can access the vast and dynamic information from any search engine for response generation. To this end, we design a query producer that generates queries from a dialogue context to interact with a search engine. The query producer is trained without any human annotation of gold queries, making it easily transferable to other domains and search engines. More specifically, we design a reinforcement learning algorithm to train the query producer, where rewards are obtained by comparing retrieved articles and gold responses. Experiments show that our query producer can achieve R@$1$ and R@$5$ rates of 62.4\% and 74.8\% for retrieving gold knowledge, and the overall model generates better responses over a strong BART (Lewis et al., 2020) model and other typical baselines.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

ArticlesChatbotResponse Generation

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Multi-Head Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

Search-Engine-augmented Dialogue Response Generation with Cheaply Supervised Query Production

2023-02-16 · Ante Wang, Linfeng Song, Qi Liu, Haitao Mi 외

Knowledge-aided dialogue response generation aims at augmenting chatbots with relevant external knowledge in the hope of generating more informative responses. The majority of previous work assumes that the relevant know…

ArticlesChatbotResponse Generation

PolyResponse: A Rank-based Approach to Task-Oriented Dialogue with Application in Restaurant Search and Booking

2019-09-03 · IJCNLP 2019 11 · Matthew Henderson, Ivan Vulić, Iñigo Casanueva, Paweł Budzianowski 외

We present PolyResponse, a conversational search engine that supports task-oriented dialogue. It is a retrieval-based approach that bypasses the complex multi-component design of traditional task-oriented dialogue system…

Conversational SearchRetrievalTask-Oriented Dialogue Systems

Language Models that Seek for Knowledge: Modular Search & Generation for Dialogue and Prompt Completion

2022-03-24 · Kurt Shuster, Mojtaba Komeili, Leonard Adolphs, Stephen Roller 외

Language models (LMs) have recently been shown to generate more factual responses by employing modularity (Zhou et al., 2021) in combination with retrieval (Adolphs et al., 2021). We extend the recent approach of Adolphs…

Language ModelingLanguage ModellingRetrieval

Medical Dialogue Response Generation with Pivotal Information Recalling

2022-06-17 · Yu Zhao, Yunxin Li, Yuxiang Wu, Baotian Hu 외

Medical dialogue generation is an important yet challenging task. Most previous works rely on the attention mechanism and large-scale pretrained language models. However, these methods often fail to acquire pivotal infor…

Dialogue GenerationGraph AttentionResponse Generation

Knowledge Injection into Dialogue Generation via Language Models

2020-04-30 · Yi-Lin Tuan, Wei Wei, William Yang Wang

Dialogue generation has been successfully learned from scratch by neural networks, but tends to produce the same general response, e.g., "what are you talking about?", in many conversations. To reduce this homogeneity, e…

Dialogue GenerationLanguage ModelingLanguage Modelling