Self-Attention-Based Message-Relevant Response Generation for Neural Conversation Model
Using a sequence-to-sequence framework, many neural conversation models for chit-chat succeed in naturalness of the response. Nevertheless, the neural conversation models tend to give generic responses which are not specific to given messages, and it still remains as a challenge. To alleviate the tendency, we propose a method to promote message-relevant and diverse responses for neural conversation model by using self-attention, which is time-efficient as well as effective. Furthermore, we present an investigation of why and how effective self-attention is in deep comparison with the standard dialogue generation. The experiment results show that the proposed method improves the standard dialogue generation in various evaluation metrics.
Code (0)
등록된 구현이 없습니다.
Tasks
Dialogue GenerationResponse GenerationSimilar Papers 제목 키워드 기반
ReCoSa: Detecting the Relevant Contexts with Self-Attention for Multi-turn Dialogue Generation
In multi-turn dialogue generation, response is usually related with only a few contexts. Therefore, an ideal model should be able to detect these relevant contexts and produce a suitable response accordingly. However, th…
Dialogue GenerationResponse GenerationTopic Aware Neural Response Generation
We consider incorporating topic information into the sequence-to-sequence framework to generate informative and interesting responses for chatbots. To this end, we propose a topic aware sequence-to-sequence (TA-Seq2Seq) …
Response GenerationGenerating High-Quality and Informative Conversation Responses with Sequence-to-Sequence Models
Sequence-to-sequence models have been applied to the conversation response generation problem where the source sequence is the conversation history and the target sequence is the response. Unlike translation, conversatio…
DecoderDiversityRerankingResponse Generation+1Detecting Context Dependent Messages in a Conversational Environment
While automatic response generation for building chatbot systems has drawn a lot of attention recently, there is limited understanding on when we need to consider the linguistic context of an input text in the generation…
ChatbotResponse GenerationAtomic Self-Consistency for Better Long Form Generations
Recent work has aimed to improve LLM generations by filtering out hallucinations, thereby improving the precision of the information in responses. Correctness of a long-form response, however, also depends on the recall …
Form