Word Ordering Without Syntax
Recent work on word ordering has argued that syntactic structure is important, or even required, for effectively recovering the order of a sentence. We find that, in fact, an n-gram language model with a simple heuristic gives strong results on this task. Furthermore, we show that a long short-term memory (LSTM) language model is even more effective at recovering order, with our basic model outperforming a state-of-the-art syntactic model by 11.5 BLEU points. Additional data and larger beams yield further gains, at the expense of training and search time.
Code (1)
Tasks
Language ModelingLanguage ModellingSentenceSimilar Papers 제목 키워드 기반
Word Ordering as Unsupervised Learning Towards Syntactically Plausible Word Representations
The research question we explore in this study is how to obtain syntactically plausible word representations without using human annotations. Our underlying hypothesis is that word ordering tests, or linearizations, is s…
Dependency ParsingPart-Of-Speech TaggingWord EmbeddingsDiscriminative Syntax-Based Word Ordering for Text Generation
Syntax-Based Word Ordering Incorporating a Large-Scale Language Model
NILC-SWORNEMO at the Surface Realization Shared Task: Exploring Syntax-Based Word Ordering using Neural Models
This paper describes the submission by the NILC Computational Linguistics research group of the University of S{\~a}o Paulo/Brazil to the Track 1 of the Surface Realization Shared Task (SRST Track 1). We present a neural…
Language ModelingLanguage ModellingLEMMASentence+1Using Wordnet to Improve Reordering in Hierarchical Phrase-Based Statistical Machine Translation
We propose the use of WordNet synsets in a syntax-based reordering model for hierarchical statistical machine translation (HPB-SMT) to enable the model to generalize to phrases not seen in the training data but that have…
Machine TranslationTranslation