paper-with-me

홈 › Papers

Improving Graph-based Sentence Ordering with Iteratively Predicted Pairwise Orderings

2021-10-13 · EMNLP 2021 11 · Shaopeng Lai, Ante Wang, Fandong Meng, Jie zhou, Yubin Ge, Jiali Zeng, Junfeng Yao, Degen Huang, Jinsong Su

Dominant sentence ordering models can be classified into pairwise ordering models and set-to-sequence models. However, there is little attempt to combine these two types of models, which inituitively possess complementary advantages. In this paper, we propose a novel sentence ordering framework which introduces two classifiers to make better use of pairwise orderings for graph-based sentence ordering. Specially, given an initial sentence-entity graph, we first introduce a graph-based classifier to predict pairwise orderings between linked sentences. Then, in an iterative manner, based on the graph updated by previously predicted high-confident pairwise orderings, another classifier is used to predict the remaining uncertain pairwise orderings. At last, we adapt a GRN-based sentence ordering model on the basis of final graph. Experiments on five commonly-used datasets demonstrate the effectiveness and generality of our model. Particularly, when equipped with BERT and FHDecoder, our model achieves state-of-the-art performance.

📄 PDF Abstract BibTeX arXiv:2110.06446

Code (1)

deeplearnxmu/irseg 공식 구현 pytorch

Tasks

SentenceSentence Ordering

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
WordPiece 설명 없음
Adam 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

Local and Global Context-Based Pairwise Models for Sentence Ordering

2021-10-08 · Ruskin Raj Manku, Aditya Jyoti Paul

Sentence Ordering refers to the task of rearranging a set of sentences into the appropriate coherent order. For this task, most previous approaches have explored global context-based end-to-end methods using Sequence Gen…

SentenceSentence Ordering

Topic-Guided Coherence Modeling for Sentence Ordering by Preserving Global and Local Information

2019-11-01 · IJCNLP 2019 11 · Byungkook Oh, Seungmin Seo, Cheolheon Shin, Eunju Jo 외

We propose a novel topic-guided coherence modeling (TGCM) for sentence ordering. Our attention based pointer decoder directly utilize sentence vectors in a permutation-invariant manner, without being compressed into a si…

DecoderSentenceSentence Ordering

Deep Attentive Ranking Networks for Learning to Order Sentences

2019-12-31 · AAAI-2020 2019 12 · Pawan Kumar, Dhanajit Brahma, Harish Karnick, Piyush Rai

We present an attention-based ranking framework for learning to order sentences given a paragraph. Our framework is built on a bidirectional sentence encoder and a self-attention based transformer network to obtain an in…

SentenceSentence Ordering

Neural Sentence Ordering

2016-07-23 · Xinchi Chen, Xipeng Qiu, Xuanjing Huang

Sentence ordering is a general and critical task for natural language generation applications. Previous works have focused on improving its performance in an external, downstream task, such as multi-document summarizatio…

Document SummarizationMulti-Document SummarizationSentenceSentence Ordering+1

Graph-based Neural Sentence Ordering

2019-12-16 · Yongjing Yin, Linfeng Song, Jinsong Su, Jiali Zeng 외

Sentence ordering is to restore the original paragraph from a set of sentences. It involves capturing global dependencies among sentences regardless of their input order. In this paper, we propose a novel and flexible gr…

SentenceSentence Ordering