Discourse Self-Attention for Discourse Element Identification in Argumentative Student Essays
This paper proposes to adapt self-attention to discourse level for modeling discourse elements in argumentative student essays. Specifically, we focus on two issues. First, we propose structural sentence positional encodings to explicitly represent sentence positions. Second, we propose to use inter-sentence attentions to capture sentence interactions and enhance sentence representation. We conduct experiments on two datasets: a Chinese dataset and an English dataset. We find that (i) sentence positional encoding can lead to a large improvement for identifying discourse elements; (ii) a structural relative positional encoding of sentences shows to be most effective; (iii) inter-sentence attention vectors are useful as a kind of sentence representations for identifying discourse elements.
Code (0)
등록된 구현이 없습니다.
Tasks
SentenceSimilar Papers 제목 키워드 기반
Toward Fast and Accurate Neural Discourse Segmentation
Discourse segmentation, which segments texts into Elementary Discourse Units, is a fundamental step in discourse analysis. Previous discourse segmenters rely on complicated hand-crafted features and are not practical in …
Discourse SegmentationDiscourse Element Identification in Student Essays based on Global and Local Cohesion
A Transformer Based Approach towards Identification of Discourse Unit Segments and Connectives
Discourse parsing, which involves understanding the structure, information flow, and modeling the coherence of a given text, is an important task in natural language processing. It forms the basis of several natural lang…
Discourse ParsingDiscourse SegmentationPOSQuestion Answering+3Joint Syntacto-Discourse Parsing and the Syntacto-Discourse Treebank
Discourse parsing has long been treated as a stand-alone problem independent from constituency or dependency parsing. Most attempts at this problem are pipelined rather than end-to-end, sophisticated, and not self-contai…
Dependency ParsingDiscourse ParsingMulti-task Attention-based Neural Networks for Implicit Discourse Relationship Representation and Identification
We present a novel multi-task attention based neural network model to address implicit discourse relationship representation and identification through two types of representation learning, an attention based neural netw…
Multi-Task LearningReading ComprehensionRepresentation LearningSentiment Analysis+1