A Retrieval-Augmented Generation Framework for Academic Literature Navigation in Data Science

2024-12-19 · Ahmet Yasin Aytar, Kemal Kilic, Kamer Kaya

In the rapidly evolving field of data science, efficiently navigating the expansive body of academic literature is crucial for informed decision-making and innovation. This paper presents an enhanced Retrieval-Augmented Generation (RAG) application, an artificial intelligence (AI)-based system designed to assist data scientists in accessing precise and contextually relevant academic resources. The AI-powered application integrates advanced techniques, including the GeneRation Of BIbliographic Data (GROBID) technique for extracting bibliographic information, fine-tuned embedding models, semantic chunking, and an abstract-first retrieval method, to significantly improve the relevance and accuracy of the retrieved information. This implementation of AI specifically addresses the challenge of academic literature navigation. A comprehensive evaluation using the Retrieval-Augmented Generation Assessment System (RAGAS) framework demonstrates substantial improvements in key metrics, particularly Context Relevance, underscoring the system's effectiveness in reducing information overload and enhancing decision-making processes. Our findings highlight the potential of this enhanced Retrieval-Augmented Generation system to transform academic exploration within data science, ultimately advancing the workflow of research and innovation in the field.

📄 PDF Abstract BibTeX arXiv:2412.15404

Code (0)

등록된 구현이 없습니다.

Tasks

Chunking Decision Making RAG RetrievalRetrieval-augmented Generation

Engineering the RAG Stack: A Comprehensive Review of the Architecture and Trust Frameworks for Retrieval-Augmented Generation Systems

2025-11-07 · Dean Wampler, Dave Nielson, Alireza Seddighi arxiv

This article provides a comprehensive systematic literature review of academic studies, industrial applications, and real-world deployments from 2018 to 2025, providing a practical guide and detailed overview of modern R…

ScholarCopilot: Training Large Language Models for Academic Writing with Accurate Citations

2025-04-01 · YuBo Wang, Xueguang Ma, Ping Nie, Huaye Zeng 외

Academic writing requires both coherent text generation and precise citation of relevant literature. Although recent Retrieval-Augmented Generation (RAG) systems have significantly improved factual accuracy in general-pu…

Articles RAG Retrieval Retrieval-augmented Generation+1

Evaluating Chunking Strategies for Retrieval-Augmented Generation on Academic Texts

2026-07-02 · Valentin J. J. Kreileder, Johannes Reisinger, Andreas Fischer arxiv

Retrieval-Augmented Generation (RAG) systems use the question-answering capabilities of Large Language Models (LLMs) to access information outside their parameters. We evaluate if cluster-based semantic chunking improves…

SF-RAG: Structure-Fidelity Retrieval-Augmented Generation for Academic Question Answering

2026-02-14 · Rui Yu, Tianyi Wang, Ruixia Liu, Yinglong Wang arxiv

Efficient question-answering (QA) over extensive scientific literature is essential for evidence-based engineering decision-making. Retrieval-augmented generation (RAG) is increasingly applied to question-answering over …

Question Answering

AutoSurvey2: Empowering Researchers with Next Level Automated Literature Surveys

2025-10-29 · Siyi Wu, Chiaxin Liang, Ziqian Bi, Leyi Zhao 외 arxiv

The rapid growth of research literature, particularly in large language models (LLMs), has made producing comprehensive and current survey papers increasingly difficult. This paper introduces autosurvey2, a multi-stage p…