Incorporating Joint Embeddings into Goal-Oriented Dialogues with Multi-Task Learning
Attention-based encoder-decoder neural network models have recently shown promising results in goal-oriented dialogue systems. However, these models struggle to reason over and incorporate state-full knowledge while preserving their end-to-end text generation functionality. Since such models can greatly benefit from user intent and knowledge graph integration, in this paper we propose an RNN-based end-to-end encoder-decoder architecture which is trained with joint embeddings of the knowledge graph and the corpus as input. The model provides an additional integration of user intent along with text generation, trained with a multi-task learning paradigm along with an additional regularization technique to penalize generating the wrong entity as output. The model further incorporates a Knowledge Graph entity lookup during inference to guarantee the generated output is state-full based on the local knowledge graph provided. We finally evaluated the model using the BLEU score, empirical evaluation depicts that our proposed architecture can aid in the betterment of task-oriented dialogue system`s performance.
Code (1)
Tasks
DecoderGoal-Oriented DialogGoal-Oriented Dialogue SystemsMulti-Task LearningText GenerationSimilar Papers 제목 키워드 기반
Goal-Oriented Semantic Communications for 6G Networks
Upon the arrival of emerging devices, including Extended Reality (XR) and Unmanned Aerial Vehicles (UAVs), the traditional communication framework is approaching Shannon's physical capacity limit and fails to guarantee t…
Semantic CommunicationAn Empirical Study on Leveraging Position Embeddings for Target-oriented Opinion Words Extraction
Target-oriented opinion words extraction (TOWE) (Fan et al., 2019b) is a new subtask of target-oriented sentiment analysis that aims to extract opinion words for a given aspect in text. Current state-of-the-art methods l…
PositionSentiment Analysistarget-oriented opinion words extractionWord EmbeddingsPersonalization in Goal-Oriented Dialog
The main goal of modeling human conversation is to create agents which can interact with people in both open-ended and goal-oriented scenarios. End-to-end trained neural dialog systems are an important line of research f…
Goal-Oriented DialogMulti-Task LearningIncorporating Task-specific Concept Knowledge into Script Learning
In this paper, we present Tetris, a new task of Goal-Oriented Script Completion. Unlike previous work, it considers a more realistic and general setting, where the input includes not only the goal but also additional use…
Contrastive LearningHallucinationContextual Biasing of Language Models for Speech Recognition in Goal-Oriented Conversational Agents
Goal-oriented conversational interfaces are designed to accomplish specific tasks and typically have interactions that tend to span multiple turns adhering to a pre-defined structure and a goal. However, conventional neu…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)ChatbotNatural Language Understanding+3