Representation Learning for Resource-Constrained Keyphrase Generation
State-of-the-art keyphrase generation methods generally depend on large annotated datasets, limiting their performance in domains with constrained resources. To overcome this challenge, we investigate pre-training strategies to learn an intermediate representation suitable for the keyphrase generation task. We introduce salient span recovery and salient span prediction as guided denoising language modeling objectives that condense the domain-specific knowledge essential for keyphrase generation. Through experiments on benchmarks spanning multiple domains, we show the effectiveness of the proposed approaches for facilitating low resource and zero-shot keyphrase generation.
Code (0)
등록된 구현이 없습니다.
Tasks
DenoisingKeyphrase GenerationLanguage ModelingLanguage ModellingRepresentation LearningSimilar Papers 제목 키워드 기반
Representation Learning for Resource-Constrained Keyphrase Generation
State-of-the-art keyphrase generation methods generally depend on large annotated datasets, limiting their performance in domains with limited annotated data. To overcome this challenge, we design a data-oriented approac…
DenoisingDomain AdaptationKeyphrase GenerationLanguage Modeling+3Data Augmentation for Low-Resource Keyphrase Generation
Keyphrase generation is the task of summarizing the contents of any given article into a few salient phrases (or keyphrases). Existing works for the task mostly rely on large-scale annotated datasets, which are not easy …
ArticlesData AugmentationKeyphrase GenerationKPDrop: Improving Absent Keyphrase Generation
Keyphrase generation is the task of generating phrases (keyphrases) that summarize the main topics of a given document. Keyphrases can be either present or absent from the given document. While the extraction of present …
Keyphrase GenerationAutoregressive Language Model for Zero-shot Constrained Keyphrase Generation
Recently, most of the state-of-the-art keyphrase prediction models are based on a supervised generative model. It shows significantly better than before. Nevertheless, it still faces domain robustness and building datase…
Keyphrase GenerationLanguage ModelingLanguage ModellingCausal Language Model for Zero-shot Constrained Keyphrase Generation
Recently, most of the state-of-the-art keyphrase prediction models are based on a supervised generative model.Although it shows noticeable improvement over statistical methods, it still struggles with low performance on …
Keyphrase GenerationLanguage ModelingLanguage Modelling