Modeling Compositionality with Dependency Graph for Dialogue Generation
Because of the compositionality of natural language, syntactic structure which contains the information about the relationship between words is a key factor for semantic understanding. However, the widely adopted Transformer is hard to learn the syntactic structure effectively in dialogue generation tasks. To explicitly model the compositionaity of language in Transformer Block, we restrict the information flow between words by constructing directed dependency graph and propose Dependency Relation Attention (DRA). Experimental results demonstrate that DRA can further improve the performance of state-of-the-art models for dialogue generation.
Code (0)
등록된 구현이 없습니다.
Tasks
Dialogue GenerationSimilar Papers 제목 키워드 기반
Incorporate Dependency Relation Knowledge into Transformer Block for Multi-turn Dialogue Generation
Because of the compositionality of natural language, syntactic structure is one of the key factors for semantic understanding. However, the Transformer block, which is widely used for obtaining the distributed representa…
Dialogue GenerationRelationPredicting Evoked Emotions in Conversations
Understanding and predicting the emotional trajectory in multi-party multi-turn conversations is of great significance. Such information can be used, for example, to generate empathetic response in human-machine interact…
Slot Dependency Modeling for Zero-Shot Cross-Domain Dialogue State Tracking
Zero-shot learning for Dialogue State Tracking (DST) focuses on generalizing to an unseen domain without the expense of collecting in domain data. However, previous zero-shot DST methods ignore the slot dependencies in a…
Dialogue State TrackingZero-Shot LearningRecurrent Convolutional Neural Networks for Discourse Compositionality
The compositionality of meaning extends beyond the single sentence. Just as words combine to form the meaning of sentences, so do sentences combine to form the meaning of paragraphs, dialogues and general discourse. We i…
Dialogue Act ClassificationFeature EngineeringSentenceGraph Convolutional Network with Sequential Attention For Goal-Oriented Dialogue Systems
Domain specific goal-oriented dialogue systems typically require modeling three types of inputs, viz., (i) the knowledge-base associated with the domain, (ii) the history of the conversation, which is a sequence of utter…
Document DatingGoal-Oriented Dialogue SystemsMachine TranslationSemantic Role Labeling