Causal Language Model for Zero-shot Constrained Keyphrase Generation
Recently, most of the state-of-the-art keyphrase prediction models are based on a supervised generative model.Although it shows noticeable improvement over statistical methods, it still struggles with low performance on out of the domain and low-resource data. To overcome these limitations, unsupervised methods have also been critical and studied. But the unsupervised method also has a defect in the necessary process which extracting candidates before selecting keyphrases. As not including various forms of phrases, we note that the unsupervised method can't ensure oracle keyphrase.In this paper, we present zero-shot constrained keyphrase generation by leveraging a large-scale language model. To generate diverse keyphrases, we explore controlling a phrase during the generation. Finally, we evaluate benchmark datasets of the scholar domain. It results in better performances than unsupervised methods on several datasets without going through the candidate extraction stage. For domain robustness, we evaluate out-of-domain DUC compare with NUS. Since our method doesn't fine-tune to a corpus of a specific domain, it's better than supervised methods based on Sequence-to-Sequence.
Code (0)
등록된 구현이 없습니다.
Tasks
Keyphrase GenerationLanguage ModelingLanguage ModellingSimilar Papers 제목 키워드 기반
Autoregressive Language Model for Zero-shot Constrained Keyphrase Generation
Recently, most of the state-of-the-art keyphrase prediction models are based on a supervised generative model. It shows significantly better than before. Nevertheless, it still faces domain robustness and building datase…
Keyphrase GenerationLanguage ModelingLanguage ModellingRepresentation Learning for Resource-Constrained Keyphrase Generation
State-of-the-art keyphrase generation methods generally depend on large annotated datasets, limiting their performance in domains with constrained resources. To overcome this challenge, we investigate pre-training strate…
DenoisingKeyphrase GenerationLanguage ModelingLanguage Modelling+1Large Language Models as Zero-Shot Keyphrase Extractors: A Preliminary Empirical Study
Zero-shot keyphrase extraction aims to build a keyphrase extractor without training by human-annotated data, which is challenging due to the limited human intervention involved. Challenging but worthwhile, zero-shot sett…
Keyphrase ExtractionLanguage ModelingLanguage ModellingLarge Language ModelRepresentation Learning for Resource-Constrained Keyphrase Generation
State-of-the-art keyphrase generation methods generally depend on large annotated datasets, limiting their performance in domains with limited annotated data. To overcome this challenge, we design a data-oriented approac…
DenoisingDomain AdaptationKeyphrase GenerationLanguage Modeling+3Key Algorithms for Keyphrase Generation: Instruction-Based LLMs for Russian Scientific Keyphrases
Keyphrase selection is a challenging task in natural language processing that has a wide range of applications. Adapting existing supervised and unsupervised solutions for the Russian language faces several limitations d…
Keyphrase Generation