paper-with-me

Papers

Retrieval-Augmented Generation in Industry: An Interview Study on Use Cases, Requirements, Challenges, and Evaluation

2025-08-11 · Lorenz Brehme, Benedikt Dornauer, Thomas Ströhle, Maximilian Ehrhart, Ruth Breu arxiv

Retrieval-Augmented Generation (RAG) is a well-established and rapidly evolving field within AI that enhances the outputs of large language models by integrating relevant information retrieved from external knowledge sources. While industry adoption of RAG is now beginning, there is a significant lack of research on its practical application in industrial contexts. To address this gap, we conducted a semistructured interview study with 13 industry practitioners to explore the current state of RAG adoption in real-world settings. Our study investigates how companies apply RAG in practice, providing (1) an overview of industry use cases, (2) a consolidated list of system requirements, (3) key challenges and lessons learned from practical experiences, and (4) an analysis of current industry evaluation methods. Our main findings show that current RAG applications are mostly limited to domain-specific QA tasks, with systems still in prototype stages; industry requirements focus primarily on data protection, security, and quality, while issues such as ethics, bias, and scalability receive less attention; data preprocessing remains a key challenge, and system evaluation is predominantly conducted by humans rather than automated methods.

📄 PDF Abstract BibTeX arXiv:2508.14066

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Reconciling Methodological Paradigms: Employing Large Language Models as Novice Qualitative Research Assistants in Talent Management Research

2024-08-20 · Sreyoshi Bhaduri, Satya Kapoor, Alex Gil, Anshul Mittal 외

Qualitative data collection and analysis approaches, such as those employing interviews and focus groups, provide rich insights into customer attitudes, sentiment, and behavior. However, manually analyzing qualitative da…

Information RetrievalManagementRAGRetrieval+1

Explainable Depression Detection in Clinical Interviews with Personalized Retrieval-Augmented Generation

2025-03-03 · Linhai Zhang, Ziyang Gao, Deyu Zhou, Yulan He

Depression is a widespread mental health disorder, and clinical interviews are the gold standard for assessment. However, their reliance on scarce professionals highlights the need for automated detection. Current system…

Depression DetectionHallucinationRetrievalRetrieval-augmented Generation

PersonaCite: VoC-Grounded Interviewable Agentic Synthetic AI Personas for Verifiable User and Design Research

2026-01-29 · Mario Truss arxiv

LLM-based and agent-based synthetic personas are increasingly used in design and product decision-making, yet prior work shows that prompt-based personas often produce persuasive but unverifiable responses that obscure t…

Data Quality Challenges in Retrieval-Augmented Generation

2025-10-01 · Leopold Müller, Joshua Holstein, Sarah Bause, Gerhard Satzger 외 arxiv

Organizations increasingly adopt Retrieval-Augmented Generation (RAG) to enhance Large Language Models with enterprise-specific knowledge. However, current data quality (DQ) frameworks have been primarily developed for s…

KemenkeuGPT: Leveraging a Large Language Model on Indonesia's Government Financial Data and Regulations to Enhance Decision Making

2024-07-31 · Gilang Fajar Febrian, Grazziela Figueredo

Data is crucial for evidence-based policymaking and enhancing public services, including those at the Ministry of Finance of the Republic of Indonesia. However, the complexity and dynamic nature of governmental financial…

BenchmarkingDecision MakingLanguage ModelingLanguage Modelling+5