Variational Neural Discourse Relation Recognizer
Implicit discourse relation recognition is a crucial component for automatic discourselevel analysis and nature language understanding. Previous studies exploit discriminative models that are built on either powerful manual features or deep discourse representations. In this paper, instead, we explore generative models and propose a variational neural discourse relation recognizer. We refer to this model as VarNDRR. VarNDRR establishes a directed probabilistic model with a latent continuous variable that generates both a discourse and the relation between the two arguments of the discourse. In order to perform efficient inference and learning, we introduce neural discourse relation models to approximate the prior and posterior distributions of the latent variable, and employ these approximated distributions to optimize a reparameterized variational lower bound. This allows VarNDRR to be trained with standard stochastic gradient methods. Experiments on the benchmark data set show that VarNDRR can achieve comparable results against stateof- the-art baselines without using any manual features.
Code (1)
Tasks
RelationSimilar Papers 제목 키워드 기반
Neural Discourse Relation Recognition with Semantic Memory
Humans comprehend the meanings and relations of discourses heavily relying on their semantic memory that encodes general knowledge about concepts and facts. Inspired by this, we propose a neural recognizer for implicit d…
General KnowledgeRelationWord EmbeddingsMemorizing All for Implicit Discourse Relation Recognition
Implicit discourse relation recognition is a challenging task due to the absence of the necessary informative clue from explicit connectives. The prediction of relations requires a deep understanding of the semantic mean…
AllRelationSemantic SimilaritySemantic Textual Similarity+1Extending Implicit Discourse Relation Recognition to the PDTB-3
The PDTB-3 contains many more Implicit discourse relations than the previous PDTB-2. This is in part because implicit relations have now been annotated within sentences as well as between them. In addition, some now co-o…
Implicit RelationsRelationResource-Lean Modeling of Coherence in Commonsense Stories
We present a resource-lean neural recognizer for modeling coherence in commonsense stories. Our lightweight system is inspired by successful attempts to modeling discourse relations and stands out due to its simplicity a…
Cloze TestReading ComprehensionSemantic Role LabelingUsing active learning to expand training data for implicit discourse relation recognition
We tackle discourse-level relation recognition, a problem of determining semantic relations between text spans. Implicit relation recognition is challenging due to the lack of explicit relational clues. The increasingly …
Active LearningRelationRelation Classification