Query-Based Keyphrase Extraction from Long Documents
Transformer-based architectures in natural language processing force input size limits that can be problematic when long documents need to be processed. This paper overcomes this issue for keyphrase extraction by chunking the long documents while keeping a global context as a query defining the topic for which relevant keyphrases should be extracted. The developed system employs a pre-trained BERT model and adapts it to estimate the probability that a given text span forms a keyphrase. We experimented using various context sizes on two popular datasets, Inspec and SemEval, and a large novel dataset. The presented results show that a shorter context with a query overcomes a longer one without the query on long documents.
Code (1)
Tasks
ChunkingKeyphrase ExtractionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
LongKey: Keyphrase Extraction for Long Documents
In an era of information overload, manually annotating the vast and growing corpus of documents and scholarly papers is increasingly impractical. Automated keyphrase extraction addresses this challenge by identifying rep…
Keyphrase ExtractionLanguage ModelingLanguage ModellingEnhancing Keyphrase Extraction from Long Scientific Documents using Graph Embeddings
In this study, we investigate using graph neural network (GNN) representations to enhance contextualized representations of pre-trained language models (PLMs) for keyphrase extraction from lengthy documents. We show that…
Graph Neural NetworkKeyphrase ExtractionKeyphrase Extraction from Scientific Articles via Extractive Summarization
Automatically extracting keyphrases from scholarly documents leads to a valuable concise representation that humans can understand and machines can process for tasks, such as information retrieval, article clustering and…
ArticlesExtractive SummarizationInformation RetrievalKeyphrase Extraction+1TermITH-Eval: a French Standard-Based Resource for Keyphrase Extraction Evaluation
Keyphrase extraction is the task of finding phrases that represent the important content of a document. The main aim of keyphrase extraction is to propose textual units that represent the most important topics developed …
Keyphrase ExtractionLDKP: A Dataset for Identifying Keyphrases from Long Scientific Documents
Identifying keyphrases (KPs) from text documents is a fundamental task in natural language processing and information retrieval. Vast majority of the benchmark datasets for this task are from the scientific domain contai…
ArticlesInformation RetrievalKeyphrase ExtractionKeyphrase Generation+1