Revolutionizing Retrieval-Augmented Generation with Enhanced PDF Structure Recognition

2024-01-23 · Demiao Lin

With the rapid development of Large Language Models (LLMs), Retrieval-Augmented Generation (RAG) has become a predominant method in the field of professional knowledge-based question answering. Presently, major foundation model companies have opened up Embedding and Chat API interfaces, and frameworks like LangChain have already integrated the RAG process. It appears that the key models and steps in RAG have been resolved, leading to the question: are professional knowledge QA systems now approaching perfection? This article discovers that current primary methods depend on the premise of accessing high-quality text corpora. However, since professional documents are mainly stored in PDFs, the low accuracy of PDF parsing significantly impacts the effectiveness of professional knowledge-based QA. We conducted an empirical RAG experiment across hundreds of questions from the corresponding real-world professional documents. The results show that, ChatDOC, a RAG system equipped with a panoptic and pinpoint PDF parser, retrieves more accurate and complete segments, and thus better answers. Empirical experiments show that ChatDOC is superior to baseline on nearly 47% of questions, ties for 38% of cases, and falls short on only 15% of cases. It shows that we may revolutionize RAG with enhanced PDF structure recognition.

📄 PDF Abstract BibTeX arXiv:2401.12599

Code (0)

등록된 구현이 없습니다.

Tasks

Question Answering RAG RetrievalRetrieval-augmented Generation

Methods 이 논문이 사용한 방법론

Attention 설명 없음

Residual Connection 설명 없음

Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.

BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Multi-Head Attention 설명 없음

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Deepchecks: Evaluating Retrieval-Augmented Generation (RAG)

2026-05-14 · Assaf Gerner, Netta Madvil, Nadav Barak, Alex Zaikman 외 arxiv

Large Language Models (LLMs) augmented with Retrieval-Augmented Generation (RAG) techniques are revolutionizing applications across multiple domains, such as healthcare, finance, and customer service. Despite their poten…

How to Build an AI Tutor That Can Adapt to Any Course Using Knowledge Graph-Enhanced Retrieval-Augmented Generation (KG-RAG)

2023-11-29 · Chenxi Dong, Yimin Yuan, Kan Chen, Shupei Cheng 외

This paper introduces KG-RAG (Knowledge Graph-enhanced Retrieval-Augmented Generation), a novel framework that addresses two critical challenges in LLM-based tutoring systems: information hallucination and limited course…

Hallucination Knowledge Graphs Language Modeling Language Modelling+5

Query-Aware Graph Neural Networks for Enhanced Retrieval-Augmented Generation

2025-07-25 · Vibhor Agrawal, Fay Wang, Rishi Puri arxiv

We present a novel graph neural network (GNN) architecture for retrieval-augmented generation (RAG) that leverages query-aware attention mechanisms and learned scoring heads to improve retrieval accuracy on complex, mult…

Graph Neural Network Question Answering Knowledge Graphs

cAST: Enhancing Code Retrieval-Augmented Generation with Structural Chunking via Abstract Syntax Tree

2025-06-18 · Yilin Zhang, Xinran Zhao, Zora Zhiruo Wang, Chenyang Yang 외

Retrieval-Augmented Generation (RAG) has become essential for large-scale code generation, grounding predictions in external code corpora to improve actuality. However, a critical yet underexplored aspect of RAG pipeline…

Chunking Code Generation RAG Retrieval+1

EHR-RAG: Bridging Long-Horizon Structured Electronic Health Records and Large Language Models via Enhanced Retrieval-Augmented Generation

2026-01-29 · Lang Cao, Qingyu Chen, Yue Guo arxiv

Electronic Health Records (EHRs) provide rich longitudinal clinical evidence that is central to medical decision-making, motivating the use of retrieval-augmented generation (RAG) to ground large language model (LLM) pre…