paper-with-me

Papers

Towards Optimizing and Evaluating a Retrieval Augmented QA Chatbot using LLMs with Human in the Loop

2024-07-08 · Anum Afzal, Alexander Kowsik, Rajna Fani, Florian Matthes

Large Language Models have found application in various mundane and repetitive tasks including Human Resource (HR) support. We worked with the domain experts of SAP SE to develop an HR support chatbot as an efficient and effective tool for addressing employee inquiries. We inserted a human-in-the-loop in various parts of the development cycles such as dataset collection, prompt optimization, and evaluation of generated output. By enhancing the LLM-driven chatbot's response quality and exploring alternative retrieval methods, we have created an efficient, scalable, and flexible tool for HR professionals to address employee inquiries effectively. Our experiments and evaluation conclude that GPT-4 outperforms other models and can overcome inconsistencies in data through internal reasoning capabilities. Additionally, through expert analysis, we infer that reference-free evaluation metrics such as G-Eval and Prometheus demonstrate reliability closely aligned with that of human evaluation.

📄 PDF Abstract BibTeX arXiv:2407.05925

Code (0)

등록된 구현이 없습니다.

Tasks

ChatbotRetrieval

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Multi-Head Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Residual Connection 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

Evaluating the Retrieval Component in LLM-Based Question Answering Systems

2024-06-10 · Ashkan Alinejad, Krtin Kumar, Ali Vahdat

Question answering systems (QA) utilizing Large Language Models (LLMs) heavily depend on the retrieval component to provide them with domain-specific information and reduce the risk of generating inaccurate responses or …

Information RetrievalQuestion AnsweringRAGRetrieval+1

RaLLe: A Framework for Developing and Evaluating Retrieval-Augmented Large Language Models

2023-08-21 · Yasuto Hoshi, Daisuke Miyashita, Youyang Ng, Kento Tatsuno 외

Retrieval-augmented large language models (R-LLMs) combine pre-trained large language models (LLMs) with information retrieval systems to improve the accuracy of factual question-answering. However, current libraries for…

Information RetrievalQuestion AnsweringRetrieval

End-to-End Chatbot Evaluation with Adaptive Reasoning and Uncertainty Filtering

2026-03-11 · Nhi Dang, Tung Le, Huy Tien Nguyen arxiv

Large language models (LLMs) combined with retrieval augmented generation have enabled the deployment of domain-specific chatbots, but these systems remain prone to generating unsupported or incorrect answers. Reliable e…

Enhancing Scientific Literature Chatbots with Retrieval-Augmented Generation: A Performance Evaluation of Vector and Graph-Based Systems

2026-02-19 · Hamideh Ghanadian, Amin Kamali, Mohammad Hossein Tekieh arxiv

This paper investigates the enhancement of scientific literature chatbots through retrieval-augmented generation (RAG), with a focus on evaluating vector- and graph-based retrieval systems. The proposed chatbot leverages…

Decision Making

Designing an Evaluation Framework for Large Language Models in Astronomy Research

2024-05-30 · John F. Wu, Alina Hyk, Kiera McCormick, Christine Ye 외

Large Language Models (LLMs) are shifting how scientific research is done. It is imperative to understand how researchers interact with these models and how scientific sub-communities like astronomy might benefit from th…

AstronomyChatbotExperimental DesignRAG+2