paper-with-me

Papers

AutoRAG: Automated Framework for optimization of Retrieval Augmented Generation Pipeline

2024-10-28 · Dongkyu Kim, Byoungwook Kim, Donggeon Han, Matouš Eibich

Using LLMs (Large Language Models) in conjunction with external documents has made RAG (Retrieval-Augmented Generation) an essential technology. Numerous techniques and modules for RAG are being researched, but their performance can vary across different datasets. Finding RAG modules that perform well on specific datasets is challenging. In this paper, we propose the AutoRAG framework, which automatically identifies suitable RAG modules for a given dataset. AutoRAG explores and approximates the optimal combination of RAG modules for the dataset. Additionally, we share the results of optimizing a dataset using AutoRAG. All experimental results and data are publicly available and can be accessed through our GitHub repository https://github.com/Marker-Inc-Korea/AutoRAG_ARAGOG_Paper .

📄 PDF Abstract BibTeX arXiv:2410.20878

Code (2)

marker-inc-korea/autorag_aragog_paper 공식 구현
marker-inc-korea/autorag

Tasks

RAGRetrievalRetrieval-augmented Generation

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Adam 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Weight Decay 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Similar Papers 제목 키워드 기반

AutoRAGTuner: A Declarative Framework for Automatic Optimization of RAG Pipelines

2026-05-03 · Xintan Zeng, Yongchao Liu, Yice Luo, Jiajun Zhen arxiv

Retrieval-Augmented Generation (RAG) enhances LLMs, but performance is highly sensitive to complex architecture designs and hyper-parameter configurations, which currently rely on inefficient manual tuning. We present Au…

AutoRAG-LoRA: Hallucination-Triggered Knowledge Retuning via Lightweight Adapters

2025-07-11 · Kaushik Dwivedi, Padmanabh Patanjali Mishra arxiv

Large Language Models (LLMs) have demonstrated remarkable fluency across a range of natural language tasks, yet remain vulnerable to hallucinations - factual inaccuracies that undermine trust in real world deployment. We…

AutoRAG-HP: Automatic Online Hyper-Parameter Tuning for Retrieval-Augmented Generation

2024-06-27 · Jia Fu, Xiaoting Qin, Fangkai Yang, Lu Wang 외

Recent advancements in Large Language Models have transformed ML/AI development, necessitating a reevaluation of AutoML principles for the Retrieval-Augmented Generation (RAG) systems. To address the challenges of hyper-…

AutoMLEfficient ExplorationNatural QuestionsRAG+2

EasyRAG: Efficient Retrieval-Augmented Generation Framework for Automated Network Operations

2024-10-14 · Zhangchi Feng, Dongdong Kuang, Zhongyuan Wang, Zhijie Nie 외

This paper presents EasyRAG, a simple, lightweight, and efficient retrieval-augmented generation framework for automated network operations. Our framework has three advantages. The first is accurate question answering. W…

Answer GenerationQuestion AnsweringRAGReranking+2

Retrieval-Augmented Large Language Models for Evidence-Informed Guidance on Cannabidiol Use in Older Adults

2026-01-16 · Ali Abedi, Charlene H. Chu, Shehroz S. Khan arxiv

Older adults commonly experience chronic conditions such as pain and sleep disturbances and may consider cannabidiol for symptom management. Safe use requires appropriate dosing, careful titration, and awareness of drug …

Prompt Engineering