paper-with-me

홈 › Papers

Key Algorithms for Keyphrase Generation: Instruction-Based LLMs for Russian Scientific Keyphrases

2024-10-23 · Anna Glazkova, Dmitry Morozov, Timur Garipov

Keyphrase selection is a challenging task in natural language processing that has a wide range of applications. Adapting existing supervised and unsupervised solutions for the Russian language faces several limitations due to the rich morphology of Russian and the limited number of training datasets available. Recent studies conducted on English texts show that large language models (LLMs) successfully address the task of generating keyphrases. LLMs allow achieving impressive results without task-specific fine-tuning, using text prompts instead. In this work, we access the performance of prompt-based methods for generating keyphrases for Russian scientific abstracts. First, we compare the performance of zero-shot and few-shot prompt-based methods, fine-tuned models, and unsupervised methods. Then we assess strategies for selecting keyphrase examples in a few-shot setting. We present the outcomes of human evaluation of the generated keyphrases and analyze the strengths and weaknesses of the models through expert assessment. Our results suggest that prompt-based methods can outperform common baselines even using simple text prompts.

📄 PDF Abstract BibTeX arXiv:2410.18040

Code (0)

등록된 구현이 없습니다.

Tasks

Keyphrase Generation

Similar Papers 제목 키워드 기반

Exploring Fine-tuned Generative Models for Keyphrase Selection: A Case Study for Russian

2024-09-16 · Anna Glazkova, Dmitry Morozov

Keyphrase selection plays a pivotal role within the domain of scholarly texts, facilitating efficient information retrieval, summarization, and indexing. In this work, we explored how to apply fine-tuned generative trans…

Information RetrievalKeyphrase Extraction

Vikhr: Constructing a State-of-the-art Bilingual Open-Source Instruction-Following Large Language Model for Russian

2024-05-22 · Aleksandr Nikolich, Konstantin Korolev, Sergei Bratchikov, Igor Kiselev 외

There has been a surge in developing various Large Language Models (LLMs). However, text generation for languages other than English often faces significant challenges, including poor generation quality and reduced compu…

Instruction FollowingLanguage ModelingLanguage ModellingLarge Language Model+1

One2set + Large Language Model: Best Partners for Keyphrase Generation

2024-10-04 · Liangying Shao, Liang Zhang, Minlong Peng, Guoqi Ma 외

Keyphrase generation (KPG) aims to automatically generate a collection of phrases representing the core concepts of a given document. The dominant paradigms in KPG include one2seq and one2set. Recently, there has been in…

Keyphrase GenerationLanguage ModelingLanguage ModellingLarge Language Model

Enhancing Keyphrase Generation by BART Finetuning with Splitting and Shuffling

2023-09-13 · Bin Chen, Mizuho Iwaihara

Keyphrase generation is a task of identifying a set of phrases that best repre-sent the main topics or themes of a given text. Keyphrases are dividend int pre-sent and absent keyphrases. Recent approaches utilizing seque…

Keyphrase Generation

SGG: Learning to Select, Guide, and Generate for Keyphrase Generation

2021-05-06 · NAACL 2021 4 · Jing Zhao, Junwei Bao, Yifan Wang, Youzheng Wu 외

Keyphrases, that concisely summarize the high-level topics discussed in a document, can be categorized into present keyphrase which explicitly appears in the source text, and absent keyphrase which does not match any con…

Keyphrase GenerationText Generation