paper-with-me

Papers

Deploying Large Language Models With Retrieval Augmented Generation

2024-11-07 · Sonal Prabhune, Donald J. Berndt

Knowing that the generative capabilities of large language models (LLM) are sometimes hampered by tendencies to hallucinate or create non-factual responses, researchers have increasingly focused on methods to ground generated outputs in factual data. Retrieval Augmented Generation (RAG) has emerged as a key approach for integrating knowledge from data sources outside of the LLM's training set, including proprietary and up-to-date information. While many research papers explore various RAG strategies, their true efficacy is tested in real-world applications with actual data. The journey from conceiving an idea to actualizing it in the real world is a lengthy process. We present insights from the development and field-testing of a pilot project that integrates LLMs with RAG for information retrieval. Additionally, we examine the impacts on the information value chain, encompassing people, processes, and technology. Our aim is to identify the opportunities and challenges of implementing this emerging technology, particularly within the context of behavioral research in the information systems (IS) field. The contributions of this work include the development of best practices and recommendations for adopting this promising technology while ensuring compliance with industry regulations through a proposed AI governance model.

📄 PDF Abstract BibTeX arXiv:2411.11895

Code (1)

SonalPrabhune/RAG 공식 구현

Tasks

Information RetrievalRAGRetrievalRetrieval-augmented Generation

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
WordPiece 설명 없음
Weight Decay 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

Searching for Best Practices in Retrieval-Augmented Generation

2024-07-01 · Xiaohua Wang, Zhenghua Wang, Xuan Gao, Feiran Zhang 외

Retrieval-augmented generation (RAG) techniques have proven to be effective in integrating up-to-date information, mitigating hallucinations, and enhancing response quality, particularly in specialized domains. While man…

Question AnsweringRAGRetrievalRetrieval-augmented Generation

Model-Driven Quantum Code Generation Using Large Language Models and Retrieval-Augmented Generation

2025-08-28 · Nazanin Siavash, Armin Moin arxiv

This paper introduces a novel research direction for model-to-text/code transformations by leveraging Large Language Models (LLMs) that can be enhanced with Retrieval-Augmented Generation (RAG) pipelines. The focus is on…

Code Generation

RAGe: A Retrieval-Augmented Generation Evaluation Framework

2026-05-23 · Larissa Guder, João Pedro de Moura, Arthur Accorsi, Gustavo Losch do Amaral 외 arxiv

Deploying Large Language Model (LLM) applications, particularly those relying on Retrieval-Augmented Generation (RAG), remains challenging due to high computational demands, outdated knowledge bases, and the need to manu…

Reducing hallucination in structured outputs via Retrieval-Augmented Generation

2024-04-12 · Patrice Béchard, Orlando Marquez Ayala

A common and fundamental limitation of Generative AI (GenAI) is its propensity to hallucinate. While large language models (LLM) have taken the world by storm, without eliminating or at least reducing hallucinations, rea…

HallucinationRAGRetrievalRetrieval-augmented Generation

RAG Does Not Work for Enterprises

2024-05-31 · Tilmann Bruckhaus

Retrieval-Augmented Generation (RAG) improves the accuracy and relevance of large language model outputs by incorporating knowledge retrieval. However, implementing RAG in enterprises poses challenges around data securit…

Language ModelingLanguage ModellingLarge Language ModelRAG+2