ZhiFangDanTai: Fine-tuning Graph-based Retrieval-Augmented Generation Model for Traditional Chinese Medicine Formula

2025-09-06 · ZiXuan Zhang, Bowen Hao, Yingjie Li, Hongzhi Yin arxiv

Traditional Chinese Medicine (TCM) formulas play a significant role in treating epidemics and complex diseases. Existing models for TCM utilize traditional algorithms or deep learning techniques to analyze formula relationships, yet lack comprehensive results, such as complete formula compositions and detailed explanations. Although recent efforts have used TCM instruction datasets to fine-tune Large Language Models (LLMs) for explainable formula generation, existing datasets lack sufficient details, such as the roles of the formula's sovereign, minister, assistant, courier; efficacy; contraindications; tongue and pulse diagnosis-limiting the depth of model outputs. To address these challenges, we propose ZhiFangDanTai, a framework combining Graph-based Retrieval-Augmented Generation (GraphRAG) with LLM fine-tuning. ZhiFangDanTai uses GraphRAG to retrieve and synthesize structured TCM knowledge into concise summaries, while also constructing an enhanced instruction dataset to improve LLMs' ability to integrate retrieved information. Furthermore, we provide novel theoretical proofs demonstrating that integrating GraphRAG with fine-tuning techniques can reduce generalization error and hallucination rates in the TCM formula task. Experimental results on both collected and clinical datasets demonstrate that ZhiFangDanTai achieves significant improvements over state-of-the-art models. Our model is open-sourced at https://huggingface.co/tczzx6/ZhiFangDanTai1.0.

📄 PDF Abstract BibTeX arXiv:2509.05867

Code (0)

등록된 구현이 없습니다.

Zero-shot Graph Reasoning via Retrieval Augmented Framework with LLMs

2025-09-16 · Hanqing Li, Kiran Sheena Jyothi, Henry Liang, Sharika Mahadevan 외 arxiv

We propose a new, training-free method, Graph Reasoning via Retrieval Augmented Framework (GRRAF), that harnesses retrieval-augmented generation (RAG) alongside the code-generation capabilities of large language models (…

ORPHEAS: A Cross-Lingual Greek-English Embedding Model for Retrieval-Augmented Generation

2026-04-22 · Ioannis E. Livieris, Athanasios Koursaris, Alexandra Apostolopoulou, Konstantinos Kanaris Dimitris Tsakalidis 외 arxiv

Effective retrieval-augmented generation across bilingual Greek--English applications requires embedding models capable of capturing both domain-specific semantic relationships and cross-lingual semantic alignment. Exist…

GFM-RAG: Graph Foundation Model for Retrieval Augmented Generation

2025-02-03 · Linhao Luo, Zicheng Zhao, Gholamreza Haffari, Dinh Phung 외

Retrieval-augmented generation (RAG) has proven effective in integrating knowledge into large language models (LLMs). However, conventional RAGs struggle to capture complex relationships between pieces of knowledge, limi…

Graph Neural Network Knowledge Graphs RAG Retrieval+1

MMRAG-RFT: Two-stage Reinforcement Fine-tuning for Explainable Multi-modal Retrieval-augmented Generation

2025-12-19 · Shengwei Zhao, Jingwen Yao, Sitong Wei, Linhai Xu 외 arxiv

Multi-modal Retrieval-Augmented Generation (MMRAG) enables highly credible generation by integrating external multi-modal knowledge, thus demonstrating impressive performance in complex multi-modal scenarios. However, ex…

Reinforcement Learning Response Generation Answer Generation

GraphRAFT: Retrieval Augmented Fine-Tuning for Knowledge Graphs on Graph Databases

2025-04-07 · Alfred Clemedtson, Borun Shi

Large language models have shown remarkable language processing and reasoning ability but are prone to hallucinate when asked about private data. Retrieval-augmented generation (RAG) retrieves relevant data that fit into…

Knowledge Graphs RAG Retrieval Retrieval-augmented Generation