paper-with-me

Papers

Diverse Retrieval-Augmented In-Context Learning for Dialogue State Tracking

2023-07-04 · Brendan King, Jeffrey Flanigan

There has been significant interest in zero and few-shot learning for dialogue state tracking (DST) due to the high cost of collecting and annotating task-oriented dialogues. Recent work has demonstrated that in-context learning requires very little data and zero parameter updates, and even outperforms trained methods in the few-shot setting (Hu et al. 2022). We propose RefPyDST, which advances the state of the art with three advancements to in-context learning for DST. First, we formulate DST as a Python programming task, explicitly modeling language coreference as variable reference in Python. Second, since in-context learning depends highly on the context examples, we propose a method to retrieve a diverse set of relevant examples to improve performance. Finally, we introduce a novel re-weighting method during decoding that takes into account probabilities of competing surface forms, and produces a more accurate dialogue state prediction. We evaluate our approach using MultiWOZ and achieve state-of-the-art multi-domain joint-goal accuracy in zero and few-shot settings.

📄 PDF Abstract BibTeX arXiv:2307.01453

Code (1)

jlab-nlp/refpydst 공식 구현 pytorch

Tasks

Dialogue State TrackingFew-Shot LearningIn-Context LearningRetrieval

Methods 이 논문이 사용한 방법론

DST Dynamic sparse training methods train neural networks in a sparse manner, starting with an initial sparse mask, and periodically updating the mask based on some criteria.

Similar Papers 제목 키워드 기반

RAD-Bench: Evaluating Large Language Models Capabilities in Retrieval Augmented Dialogues

2024-09-19 · Tzu-Lin Kuo, Feng-Ting Liao, Mu-Wei Hsieh, Fu-Chieh Chang 외

In real-world applications with Large Language Models (LLMs), external retrieval mechanisms - such as Search-Augmented Generation (SAG), tool utilization, and Retrieval-Augmented Generation (RAG) - are often employed to …

RAGRetrievalRetrieval-augmented Generation

Dialogue Benchmark Generation from Knowledge Graphs with Cost-Effective Retrieval-Augmented LLMs

2025-01-17 · Reham Omar, Omij Mangukiya, Essam Mansour

Dialogue benchmarks are crucial in training and evaluating chatbots engaging in domain-specific conversations. Knowledge graphs (KGs) represent semantically rich and well-organized data spanning various domains, such as …

Dialogue GenerationKnowledge GraphsQuestion AnsweringRetrieval+1

DH-RAG: A Dynamic Historical Context-Powered Retrieval-Augmented Generation Method for Multi-Turn Dialogue

2025-02-19 · Feiyuan Zhang, Dezhi Zhu, James Ming, Yilun Jin 외

Retrieval-Augmented Generation (RAG) systems have shown substantial benefits in applications such as question answering and multi-turn dialogue \citep{lewis2020retrieval}. However, traditional RAG methods, while leveragi…

Question AnsweringRAGRetrievalRetrieval-augmented Generation

Conversation AI Dialog for Medicare powered by Finetuning and Retrieval Augmented Generation

2025-02-04 · Atharva Mangeshkumar Agrawal, Rutika Pandurang Shinde, Vasanth Kumar Bhukya, Ashmita Chakraborty 외

Large language models (LLMs) have shown impressive capabilities in natural language processing tasks, including dialogue generation. This research aims to conduct a novel comparative analysis of two prominent techniques,…

Data AugmentationDialogue GenerationFact CheckingRAG+2

UniMS-RAG: A Unified Multi-source Retrieval-Augmented Generation for Personalized Dialogue Systems

2024-01-24 · Hongru Wang, WenYu Huang, Yang Deng, Rui Wang 외

Large Language Models (LLMs) has shown exceptional capabilities in many natual language understanding and generation tasks. However, the personalization issue still remains a much-coveted property, especially when it com…

RAGResponse GenerationRetrievalRetrieval-augmented Generation