Unsupervised Deep Keyphrase Generation
Keyphrase generation aims to summarize long documents with a collection of salient phrases. Deep neural models have demonstrated a remarkable success in this task, capable of predicting keyphrases that are even absent from a document. However, such abstractiveness is acquired at the expense of a substantial amount of annotated data. In this paper, we present a novel method for keyphrase generation, AutoKeyGen, without the supervision of any human annotation. Motivated by the observation that an absent keyphrase in one document can appear in other places, in whole or in part, we first construct a phrase bank by pooling all phrases in a corpus. With this phrase bank, we then draw candidate absent keyphrases for each document through a partial matching process. To rank both types of candidates, we combine their lexical- and semantic-level similarities to the input document. Moreover, we utilize these top-ranked candidates as to train a deep generative model for more absent keyphrases. Extensive experiments demonstrate that AutoKeyGen outperforms all unsupervised baselines and can even beat strong supervised methods in certain cases.
Code (1)
Tasks
Keyphrase GenerationSimilar Papers 제목 키워드 기반
Causal Language Model for Zero-shot Constrained Keyphrase Generation
Recently, most of the state-of-the-art keyphrase prediction models are based on a supervised generative model.Although it shows noticeable improvement over statistical methods, it still struggles with low performance on …
Keyphrase GenerationLanguage ModelingLanguage ModellingAutoregressive Language Model for Zero-shot Constrained Keyphrase Generation
Recently, most of the state-of-the-art keyphrase prediction models are based on a supervised generative model. It shows significantly better than before. Nevertheless, it still faces domain robustness and building datase…
Keyphrase GenerationLanguage ModelingLanguage ModellingERU-KG: Efficient Reference-aligned Unsupervised Keyphrase Generation
Unsupervised keyphrase prediction has gained growing interest in recent years. However, existing methods typically rely on heuristically defined importance scores, which may lead to inaccurate informativeness estimation.…
InformativenessKeyphrase GenerationText RetrievalUnsupervised Domain Adaptation for Keyphrase Generation using Citation Contexts
Adapting keyphrase generation models to new domains typically involves few-shot fine-tuning with in-domain labeled data. However, annotating documents with keyphrases is often prohibitively expensive and impractical, req…
Domain AdaptationKeyphrase GenerationUnsupervised Domain AdaptationKeyphrase Generation: A Text Summarization Struggle
Authors' keyphrases assigned to scientific articles are essential for recognizing content and topic aspects. Most of the proposed supervised and unsupervised methods for keyphrase generation are unable to produce terms t…
ArticlesKeyphrase GenerationText Summarization