A Systematic Study of Neural Discourse Models for Implicit Discourse Relation
Inferring implicit discourse relations in natural language text is the most difficult subtask in discourse parsing. Many neural network models have been proposed to tackle this problem. However, the comparison for this task is not unified, so we could hardly draw clear conclusions about the effectiveness of various architectures. Here, we propose neural network models that are based on feedforward and long-short term memory architecture and systematically study the effects of varying structures. To our surprise, the best-configured feedforward architecture outperforms LSTM-based model in most cases despite thorough tuning. Further, we compare our best feedforward system with competitive convolutional and recurrent networks and find that feedforward can actually be more effective. For the first time for this task, we compile and publish outputs from previous neural and non-neural systems to establish the standard for further comparison.
Code (0)
등록된 구현이 없습니다.
Tasks
Discourse ParsingRelationSimilar Papers 제목 키워드 기반
Label distributions help implicit discourse relation classification
Implicit discourse relations can convey more than one relation sense, but much of the research on discourse relations has focused on single relation senses. Recently, DiscoGeM, a novel multi-domain corpus, which contains…
ClassificationImplicit Discourse Relation ClassificationRelationRelation ClassificationWhere Are We in Discourse Relation Recognition?
Discourse parsers recognize the intentional and inferential relationships that organize extended texts. They have had a great influence on a variety of NLP tasks as well as theoretical studies in linguistics and cognitiv…
Discourse ParsingImplicit RelationsRelationTowards Full Text Shallow Discourse Relation Annotation: Experiments with Cross-Paragraph Implicit Relations in the PDTB
Full text discourse parsing relies on texts comprehensively annotated with discourse relations. To this end, we address a significant gap in the inter-sentential discourse relations annotated in the Penn Discourse Treeba…
Discourse ParsingImplicit RelationsLet's be explicit about that: Distant supervision for implicit discourse relation classification via connective prediction
In implicit discourse relation classification, we want to predict the relation between adjacent sentences in the absence of any overt discourse connectives. This is challenging even for humans, leading to shortage of ann…
ClassificationImplicit Discourse Relation ClassificationImplicit RelationsLanguage Modeling+4Let’s be explicit about that: Distant supervision for implicit discourse relation classification via connective prediction
In implicit discourse relation classification, we want to predict the relation between adjacent sentences in the absence of any overt discourse connectives. This is challenging even for humans, leading to shortage of ann…
ClassificationImplicit Discourse Relation ClassificationImplicit RelationsLanguage Modeling+4