Retrieval-efficiency trade-off of Unsupervised Keyword Extraction
Efficiently identifying keyphrases that represent a given document is a challenging task. In the last years, plethora of keyword detection approaches were proposed. These approaches can be based on statistical (frequency-based) properties of e.g., tokens, specialized neural language models, or a graph-based structure derived from a given document. The graph-based methods can be computationally amongst the most efficient ones, while maintaining the retrieval performance. One of the main properties, common to graph-based methods, is their immediate conversion of token space into graphs, followed by subsequent processing. In this paper, we explore a novel unsupervised approach which merges parts of a document in sequential form, prior to construction of the token graph. Further, by leveraging personalized PageRank, which considers frequencies of such sub-phrases alongside token lengths during node ranking, we demonstrate state-of-the-art retrieval capabilities while being up to two orders of magnitude faster than current state-of-the-art unsupervised detectors such as YAKE and MultiPartiteRank. The proposed method's scalability was also demonstrated by computing keyphrases for a biomedical corpus comprised of 14 million documents in less than a minute.
Code (0)
등록된 구현이 없습니다.
Tasks
Keyword ExtractionRetrievalSimilar Papers 제목 키워드 기반
RaKUn: Rank-based Keyword extraction via Unsupervised learning and Meta vertex aggregation
Keyword extraction is used for summarizing the content of a document and supports efficient document retrieval, and is as such an indispensable part of modern text-based systems. We explore how load centrality, a graph-t…
Keyword ExtractionRetrievalEnhancing Unsupervised Keyword Extraction in Academic Papers through Integrating Highlights with Abstract
Automatic keyword extraction from academic papers is a key area of interest in natural language processing and information retrieval. Although previous research has mainly focused on utilizing abstract and references for…
Information RetrievalKeyword ExtractionOpen Domain Response Generation Guided by Retrieved Conversations
Open domain response generation is the task of creating a response givena user query in any topics/domain. Limited by context and referenceinformation, responses generated by current systems are often "bland"or generic. …
Keyword ExtractionResponse GenerationRetrievalStudy of keyword extraction techniques for Electric Double Layer Capacitor domain using text similarity indexes: An experimental analysis
Keywords perform a significant role in selecting various topic-related documents quite easily. Topics or keywords assigned by humans or experts provide accurate information. However, this practice is quite expensive in t…
Keyword ExtractionManagementRecommendation Systemstext similarityAn Improved Method for Class-specific Keyword Extraction: A Case Study in the German Business Registry
The task of $\textit{keyword extraction}$ is often an important initial step in unsupervised information extraction, forming the basis for tasks such as topic modeling or document classification. While recent methods hav…
Document ClassificationKeyword Extraction