paper-with-me

Papers

Automating Bibliometric Analysis with Sentence Transformers and Retrieval-Augmented Generation (RAG): A Pilot Study in Semantic and Contextual Search for Customized Literature Characterization for High-Impact Urban Research

2024-10-08 · Haowen Xu, Xueping Li, Jose Tupayachi, Jianming, Lian, Femi Omitaomu

Bibliometric analysis is essential for understanding research trends, scope, and impact in urban science, especially in high-impact journals, such Nature Portfolios. However, traditional methods, relying on keyword searches and basic NLP techniques, often fail to uncover valuable insights not explicitly stated in article titles or keywords. These approaches are unable to perform semantic searches and contextual understanding, limiting their effectiveness in classifying topics and characterizing studies. In this paper, we address these limitations by leveraging Generative AI models, specifically transformers and Retrieval-Augmented Generation (RAG), to automate and enhance bibliometric analysis. We developed a technical workflow that integrates a vector database, Sentence Transformers, a Gaussian Mixture Model (GMM), Retrieval Agent, and Large Language Models (LLMs) to enable contextual search, topic ranking, and characterization of research using customized prompt templates. A pilot study analyzing 223 urban science-related articles published in Nature Communications over the past decade highlights the effectiveness of our approach in generating insightful summary statistics on the quality, scope, and characteristics of papers in high-impact journals. This study introduces a new paradigm for enhancing bibliometric analysis and knowledge retrieval in urban research, positioning an AI agent as a powerful tool for advancing research evaluation and understanding.

📄 PDF Abstract BibTeX arXiv:2410.09090

Code (0)

등록된 구현이 없습니다.

Tasks

AI AgentArticlesRAGRetrievalRetrieval-augmented GenerationSentence

Similar Papers 제목 키워드 기반

Caveats for the use of Web of Science Core Collection in old literature retrieval and historical bibliometric analysis

2021-07-24 · Weishu Liu

By using publications from Web of Science Core Collection (WoSCC), Fosso Wamba and his colleagues published an interesting and comprehensive paper in Technological Forecasting and Social Change to explore the structure a…

Retrieval

Report on the 8th International Workshop on Bibliometric-enhanced Information Retrieval (BIR 2019)

2019-09-11 · Guillaume Cabanac, Ingo Frommholz, Philipp Mayr

The Bibliometric-enhanced Information Retrieval workshop series (BIR) at ECIR tackled issues related to academic search, at the crossroads between Information Retrieval and Bibliometrics. BIR is a hot topic investigated …

Information RetrievalRetrieval

Bibliometric-enhanced Information Retrieval: 2nd International BIR Workshop

2015-01-12 · Mayr Philipp, Frommholz Ingo, Scharnhorst Andrea, Mutschke Peter

This workshop brings together experts of communities which often have been perceived as different once: bibliometrics / scientometrics / informetrics on the one side and information retrieval on the other. Our motivation…

Information RetrievalRetrievalTransfer Learning

Bibliometric-enhanced Information Retrieval 10th Anniversary Workshop Edition

2020-01-20 · Guillaume Cabanac, Ingo Frommholz, Philipp Mayr

The Bibliometric-enhanced Information Retrieval workshop series (BIR) was launched at ECIR in 2014 \cite{MayrEtAl2014} and it was held at ECIR each year since then. This year we organize the 10th iteration of BIR. The wo…

Information RetrievalRetrieval

Report on the 7th International Workshop on Bibliometric-enhanced Information Retrieval (BIR 2018)

2018-04-10 · Mayr Philipp, Frommholz Ingo, Cabanac Guillaume

The Bibliometric-enhanced Information Retrieval (BIR) workshop series has started at ECIR in 2014 and serves as the annual gathering of IR researchers who address various information-related tasks on scientific corpora a…

Information RetrievalRetrieval