Recognizing Implicit Discourse Relations via Repeated Reading: Neural Networks with Multi-Level Attention
Recognizing implicit discourse relations is a challenging but important task in the field of Natural Language Processing. For such a complex text processing task, different from previous studies, we argue that it is necessary to repeatedly read the arguments and dynamically exploit the efficient features useful for recognizing discourse relations. To mimic the repeated reading strategy, we propose the neural networks with multi-level attention (NNMA), combining the attention mechanism and external memories to gradually fix the attention on some specific words helpful to judging the discourse relations. Experiments on the PDTB dataset show that our proposed method achieves the state-of-art results. The visualization of the attention weights also illustrates the progress that our model observes the arguments on each level and progressively locates the important words.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Where Are We in Discourse Relation Recognition?
Discourse parsers recognize the intentional and inferential relationships that organize extended texts. They have had a great influence on a variety of NLP tasks as well as theoretical studies in linguistics and cognitiv…
Discourse ParsingImplicit RelationsRelationDesign Choices for Crowdsourcing Implicit Discourse Relations: Revealing the Biases Introduced by Task Design
Disagreement in natural language annotation has mostly been studied from a perspective of biases introduced by the annotators and the annotation frameworks. Here, we propose to analyze another source of bias: task design…
Not Just Classification: Recognizing Implicit Discourse Relation on Joint Modeling of Classification and Generation
Implicit discourse relation recognition (IDRR) is a critical task in discourse analysis. Previous studies only regard it as a classification task and lack an in-depth understanding of the semantics of different relations…
ClassificationRelationSentenceTowards Identifying Alternative-Lexicalization Signals of Discourse Relations
The task of shallow discourse parsing in the Penn Discourse Treebank (PDTB) framework has traditionally been restricted to identifying those relations that are signaled by a discourse connective (“explicit”) and those th…
Discourse ParsingModeling Hierarchical Reasoning Chains by Linking Discourse Units and Key Phrases for Reading Comprehension
Machine reading comprehension (MRC) poses new challenges over logical reasoning, which aims to understand the implicit logical relations entailed in the given contexts and perform inference over them. Due to the complexi…
Logical ReasoningMachine Reading ComprehensionNatural Language InferenceReading Comprehension+1