Does Order Matter? An Empirical Study on Generating Multiple Keyphrases as a Sequence
Recently, concatenating multiple keyphrases as a target sequence has been proposed as a new learning paradigm for keyphrase generation. Existing studies concatenate target keyphrases in different orders but no study has examined the effects of ordering on models' behavior. In this paper, we propose several orderings for concatenation and inspect the important factors for training a successful keyphrase generation model. By running comprehensive comparisons, we observe one preferable ordering and summarize a number of empirical findings and challenges, which can shed light on future research on this line of work.
Code (1)
Tasks
Keyphrase GenerationSimilar Papers 제목 키워드 기반
Words aren't enough, their order matters: On the Robustness of Grounding Visual Referring Expressions
Visual referring expression recognition is a challenging task that requires natural language understanding in the context of an image. We critically examine RefCOCOg, a standard benchmark for this task, using a human stu…
Contrastive LearningMulti-Task LearningNatural Language UnderstandingReferring ExpressionA deep-learning algorithm to disentangle self-interacting dark matter and AGN feedback models
Different models of dark matter can alter the distribution of mass in galaxy clusters in a variety of ways. However, so can uncertain astrophysical feedback mechanisms. Here we present a Machine Learning method that ''le…
When classifying arguments, BERT doesn’t care about word order...except when it matters
Local Structure Matters Most in Most Languages
Many recent perturbation studies have found unintuitive results on what does and does not matter when performing Natural Language Understanding (NLU) tasks in English. Coding properties, such as the order of words, can o…
Natural Language UnderstandingDoes Traversal Order Matter? A Systematic Study of Tree Traversal Methods in Transformer Grammars
Transformer Grammars (TGs) enhance language modeling by incorporating syntactic tree structures. Despite the potentially significant impact on model performance of how syntactic trees are linearized in TGs, existing stud…