On the Need of Cross Validation for Discourse Relation Classification

2017-04-01 · EACL 2017 4 · Wei Shi, Vera Demberg

The task of implicit discourse relation classification has received increased attention in recent years, including two CoNNL shared tasks on the topic. Existing machine learning models for the task train on sections 2-21 of the PDTB and test on section 23, which includes a total of 761 implicit discourse relations. In this paper, we{'}d like to make a methodological point, arguing that the standard test set is too small to draw conclusions about whether the inclusion of certain features constitute a genuine improvement, or whether one got lucky with some properties of the test set, and argue for the adoption of cross validation for the discourse relation classification task by the community.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Classification General ClassificationImplicit Discourse Relation ClassificationLanguage ModelingLanguage Modelling Machine Translation Question AnsweringRelationRelation Classification

Learning to Explicitate Connectives with Seq2Seq Network for Implicit Discourse Relation Classification

2018-11-05 · WS 2019 5 · Wei Shi, Vera Demberg

Implicit discourse relation classification is one of the most difficult steps in discourse parsing. The difficulty stems from the fact that the coherence relation must be inferred based on the content of the discourse re…

Classification Discourse Parsing General Classification Implicit Discourse Relation Classification+2

Discourse Relations Classification and Cross-Framework Discourse Relation Classification Through the Lens of Cognitive Dimensions: An Empirical Investigation

2023-11-01 · Yingxue Fu

Existing discourse formalisms use different taxonomies of discourse relations, which require expert knowledge to understand, posing a challenge for annotation and automatic classification. We show that discourse relation…

Classification Discourse Segmentation Relation Classification

Discourse Relations and Conjoined VPs: Automated Sense Recognition

2017-04-01 · EACL 2017 4 · Valentina Pyatkin, Bonnie Webber

Sense classification of discourse relations is a sub-task of shallow discourse parsing. Discourse relations can occur both across sentences (\textit{inter-sentential}) and within sentences (\textit{intra-sentential}), an…

Classification Discourse Parsing General Classification Multi-Label Classification

A Knowledge-Augmented Neural Network Model for Implicit Discourse Relation Classification

2018-08-01 · COLING 2018 8 · Yudai Kishimoto, Yugo Murawaki, Sadao Kurohashi

Identifying discourse relations that are not overtly marked with discourse connectives remains a challenging problem. The absence of explicit clues indicates a need for the combination of world knowledge and weak context…

General Classification Implicit Discourse Relation Classification Machine Translation Relation+3

Multi-Label Classification for Implicit Discourse Relation Recognition

2024-06-06 · Wanqiu Long, N. Siddharth, Bonnie Webber

Discourse relations play a pivotal role in establishing coherence within textual content, uniting sentences and clauses into a cohesive narrative. The Penn Discourse Treebank (PDTB) stands as one of the most extensively …

Classification Multi-Label Classification MUlTI-LABEL-ClASSIFICATION Relation