Retrieval Augmented Thought Process for Private Data Handling in Healthcare

2024-02-12 · Thomas Pouplin, Hao Sun, Samuel Holt, Mihaela van der Schaar

Large Language Models (LLMs) have demonstrated the strong potential to assist both clinicians and the general public with their extensive medical knowledge. However, their application in healthcare is constrained due to concerns about the privacy of data used in training, which prevents the integration of private and personal information because of security and ethical issues. Moreover, if their capabilities can be enhanced with information retrieval to access up-to-date knowledge, the current integration of LLMs with Information retrieval lacks robustness to imperfect retrieval, which can hinder their effectiveness and even reduce overall performance. In this work, we address this challenge by introducing the Retrieval-Augmented Thought Process (RATP). Given access to external knowledge, RATP formulates the thought generation of LLMs as a multiple-step decision process. To optimise such a thought process, RATP leverages Monte-Carlo Tree Search and learns a proxy reward function that permits cost-efficient inference. On a private dataset of electronic medical records, deliberately excluded from any LLM training set, RATP achieves 35% additional accuracy compared to in-context retrieval-augmented generation for the question-answering task.

📄 PDF Abstract BibTeX arXiv:2402.07812

Code (0)

등록된 구현이 없습니다.

Tasks

Decision Making Information Retrieval Question Answering RetrievalRetrieval-augmented Generation

Methods 이 논문이 사용한 방법론

Monte-Carlo Tree Search Monte-Carlo Tree Search is a planning algorithm that accumulates value estimates obtained from Monte Carlo simulations in order to successively direct simulations towards more…

Similarity is Not All You Need: Endowing Retrieval Augmented Generation with Multi Layered Thoughts

2024-05-30 · Chunjing Gan, Dan Yang, Binbin Hu, Hanxiao Zhang 외

In recent years, large language models (LLMs) have made remarkable achievements in various domains. However, the untimeliness and cost of knowledge updates coupled with hallucination issues of LLMs have curtailed their a…

All Hallucination RAG Retrieval+1

RATT: A Thought Structure for Coherent and Correct LLM Reasoning

2024-06-04 · Jinghan Zhang, Xiting Wang, Weijieying Ren, Lu Jiang 외

Large Language Models (LLMs) gain substantial reasoning and decision-making capabilities from thought structures. However, existing methods such as Tree of Thought and Retrieval Augmented Thoughts often fall short in com…

Decision Making Fact Checking RAG Retrieval+1

HIRAG: Hierarchical-Thought Instruction-Tuning Retrieval-Augmented Generation

2025-07-08 · YiHan Jiao, ZheHao Tan, Dan Yang, DuoLin Sun 외 arxiv

Retrieval-augmented generation (RAG) has become a fundamental paradigm for addressing the challenges faced by large language models in handling real-time information and domain-specific problems. Traditional RAG systems …

RAR$^2$: Retrieval-Augmented Medical Reasoning via Thought-Driven Retrieval

2025-09-24 · Kaishuai Xu, Wenjun Hou, Yi Cheng, Wenjie Li arxiv

Large Language Models (LLMs) have shown promising performance on diverse medical benchmarks, highlighting their potential in supporting real-world clinical tasks. Retrieval-Augmented Generation (RAG) has emerged as a key…

Question Answering Answer Generation

RAPID: Retrieval Augmented Training of Differentially Private Diffusion Models

2025-02-18 · Tanqiu Jiang, Changjiang Li, Fenglong Ma, Ting Wang

Differentially private diffusion models (DPDMs) harness the remarkable generative capabilities of diffusion models while enforcing differential privacy (DP) for sensitive data. However, existing DPDM training approaches …

Privacy Preserving RAG Retrieval Retrieval-augmented Generation