paper-with-me

Papers

Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Survey

2021-05-10 · Jinjie Ni, Tom Young, Vlad Pandelea, Fuzhao Xue, Erik Cambria

Dialogue systems are a popular natural language processing (NLP) task as it is promising in real-life applications. It is also a complicated task since many NLP tasks deserving study are involved. As a result, a multitude of novel works on this task are carried out, and most of them are deep learning based due to the outstanding performance. In this survey, we mainly focus on the deep learning based dialogue systems. We comprehensively review state-of-the-art research outcomes in dialogue systems and analyze them from two angles: model type and system type. Specifically, from the angle of model type, we discuss the principles, characteristics, and applications of different models that are widely used in dialogue systems. This will help researchers acquaint these models and see how they are applied in state-of-the-art frameworks, which is rather helpful when designing a new dialogue system. From the angle of system type, we discuss task-oriented and open-domain dialogue systems as two streams of research, providing insight into the hot topics related. Furthermore, we comprehensively review the evaluation methods and datasets for dialogue systems to pave the way for future research. Finally, some possible research trends are identified based on the recent research outcomes. To the best of our knowledge, this survey is the most comprehensive and up-to-date one at present for deep learning based dialogue systems, extensively covering the popular techniques. We speculate that this work is a good starting point for academics who are new to the dialogue systems or those who want to quickly grasp up-to-date techniques in this area.

📄 PDF Abstract BibTeX arXiv:2105.04387

Code (0)

등록된 구현이 없습니다.

Tasks

Information RetrievalQuestion Answering

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Adam 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Multi-Head Attention 설명 없음

Similar Papers 제목 키워드 기반

A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systems

2024-02-28 · Zihao Yi, Jiarui Ouyang, YuWen Liu, Tianhao Liao 외

This survey provides a comprehensive review of research on multi-turn dialogue systems, with a particular focus on multi-turn dialogue systems based on large language models (LLMs). This paper aims to (a) give a summary …

A Survey on Dialogue Summarization: Recent Advances and New Frontiers

2021-07-07 · Xiachong Feng, Xiaocheng Feng, Bing Qin

Dialogue summarization aims to condense the original dialogue into a shorter version covering salient information, which is a crucial way to reduce dialogue data overload. Recently, the promising achievements in both dia…

SurveyText Generation

A Survey on Dialogue Systems: Recent Advances and New Frontiers

2017-11-06 · Hongshen Chen, Xiaorui Liu, Dawei Yin, Jiliang Tang

Dialogue systems have attracted more and more attention. Recent advances on dialogue systems are overwhelmingly contributed by deep learning techniques, which have been employed to enhance a wide range of big data applic…

Deep LearningRecommendation SystemsResponse GenerationSurvey

A Survey on Recent Advances and Challenges in Reinforcement Learning Methods for Task-Oriented Dialogue Policy Learning

2022-02-28 · Wai-Chung Kwan, Hongru Wang, Huimin Wang, Kam-Fai Wong

Dialogue Policy Learning is a key component in a task-oriented dialogue system (TDS) that decides the next action of the system given the dialogue state at each turn. Reinforcement Learning (RL) is commonly chosen to lea…

Dialogue ManagementManagementReinforcement Learning (RL)Survey

Let's Negotiate! A Survey of Negotiation Dialogue Systems

2024-02-02 · Haolan Zhan, YuFei Wang, Tao Feng, Yuncheng Hua 외

Negotiation is a crucial ability in human communication. Recently, there has been a resurgent research interest in negotiation dialogue systems, whose goal is to create intelligent agents that can assist people in resolv…

Survey