Is Everything in Order? A Simple Way to Order Sentences
The task of organizing a shuffled set of sentences into a coherent text has been used to evaluate a machine's understanding of causal and temporal relations. We formulate the sentence ordering task as a conditional text-to-marker generation problem. We present Reorder-BART (Re-BART) that leverages a pre-trained Transformer-based model to identify a coherent order for a given set of shuffled sentences. The model takes a set of shuffled sentences with sentence-specific markers as input and generates a sequence of position markers of the sentences in the ordered text. Re-BART achieves the state-of-the-art performance across 7 datasets in Perfect Match Ratio (PMR) and Kendall's tau ($\tau$). We perform evaluations in a zero-shot setting, showcasing that our model is able to generalize well across other datasets. We additionally perform several experiments to understand the functioning and limitations of our framework.
Code (1)
Tasks
Conditional Text GenerationSentenceSentence OrderingText GenerationSimilar Papers 제목 키워드 기반
Predicting a Protein's Stability under a Million Mutations
Stabilizing proteins is a foundational step in protein engineering. However, the evolutionary pressure of all extant proteins makes identifying the scarce number of mutations that will improve thermodynamic stability cha…
Protein Stability PredictionComplete Relativity: Nature of observables
A complete relativity of all observables with scale invariance in physical laws is postulated and discussed. Along with definitions of new terms which may be used in follow-up articles written in the context of the theo…
ArticlesFact-aware Sentence Split and Rephrase with Permutation Invariant Training
Sentence Split and Rephrase aims to break down a complex sentence into several simple sentences with its meaning preserved. Previous studies tend to address the issue by seq2seq learning from parallel sentence pairs, whi…
SentenceSplit and RephraseA Simple yet Effective Method for Sentence Ordering
Sentence ordering is the task of arranging a given bag of sentences so as to maximise the coherence of the overall text. In this work, we propose a simple yet effective training method that improves the capacity of model…
SentenceSentence OrderingSMT vs NMT: A Comparison over Hindi & Bengali Simple Sentences
In the present article, we identified the qualitative differences between Statistical Machine Translation (SMT) and Neural Machine Translation (NMT) outputs. We have tried to answer two important questions: 1. Does NMT p…
Machine TranslationNMTSentenceTranslation