paper-with-me

홈 › Papers

Beyond-RAG: Question Identification and Answer Generation in Real-Time Conversations

2024-10-14 · Garima Agrawal, Sashank Gummuluri, Cosimo Spera

In customer contact centers, human agents often struggle with long average handling times (AHT) due to the need to manually interpret queries and retrieve relevant knowledge base (KB) articles. While retrieval augmented generation (RAG) systems using large language models (LLMs) have been widely adopted in industry to assist with such tasks, RAG faces challenges in real-time conversations, such as inaccurate query formulation and redundant retrieval of frequently asked questions (FAQs). To address these limitations, we propose a decision support system that can look beyond RAG by first identifying customer questions in real time. If the query matches an FAQ, the system retrieves the answer directly from the FAQ database; otherwise, it generates answers via RAG. Our approach reduces reliance on manual queries, providing responses to agents within 2 seconds. Deployed in AI-powered human-agent assist solution at Minerva CQ, this system improves efficiency, reduces AHT, and lowers operational costs. We also introduce an automated LLM-agentic workflow to identify FAQs from historical transcripts when no predefined FAQs exist.

📄 PDF Abstract BibTeX arXiv:2410.10136

Code (0)

등록된 구현이 없습니다.

Tasks

Answer GenerationArticlesRAGRetrievalRetrieval-augmented Generation

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Multi-Head Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
WordPiece 설명 없음
Residual Connection 설명 없음
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

Perception of Knowledge Boundary for Large Language Models through Semi-open-ended Question Answering

2024-05-23 · Zhihua Wen, Zhiliang Tian, Zexin Jian, Zhen Huang 외

Large Language Models (LLMs) are widely used for knowledge-seeking yet suffer from hallucinations. The knowledge boundary (KB) of an LLM limits its factual understanding, beyond which it may begin to hallucinate. Investi…

Open-Ended Question AnsweringQuestion AnsweringRAG

Question Generation and Answering for exploring Digital Humanities collections

2022-06-01 · LREC 2022 6 · Frederic Bechet, Elie Antoine, Jérémy Auguste, Géraldine Damnati

This paper introduces the question answering paradigm as a way to explore digitized archive collections for Social Science studies. In particular, we are interested in evaluating largely studied question generation and q…

Question AnsweringQuestion GenerationQuestion-GenerationReading Comprehension

Samsung Research Poland (SRPOL) at SemEval-2022 Task 9: Hybrid Question Answering Using Semantic Roles

2022-07-01 · SemEval (NAACL) 2022 7 · Tomasz Dryjański, Monika Zaleska, Bartek Kuźma, Artur Błażejewski 외

In this work we present an overview of our winning system for the R2VQ - Competence-based Multimodal Question Answering task, with the final exact match score of 92.53%.The task is structured as question-answer pairs, qu…

Question AnsweringResponse Generation

RealTime QA: What's the Answer Right Now?

2022-07-27 · NeurIPS 2023 11 · Jungo Kasai, Keisuke Sakaguchi, Yoichi Takahashi, Ronan Le Bras 외

We introduce REALTIME QA, a dynamic question answering (QA) platform that announces questions and evaluates systems on a regular basis (weekly in this version). REALTIME QA inquires about the current world, and QA system…

Information RetrievalQuestion AnsweringRetrieval

Detecting Knowledge Boundary of Vision Large Language Models by Sampling-Based Inference

2025-02-25 · Zhuo Chen, Xinyu Wang, Yong Jiang, Zhen Zhang 외

Despite the advancements made in Visual Large Language Models (VLLMs), like text Large Language Models (LLMs), they have limitations in addressing questions that require real-time information or are knowledge-intensive. …

Question AnsweringRAGRetrievalRetrieval-augmented Generation+1