Enhancing Knowledge Retrieval with Topic Modeling for Knowledge-Grounded Dialogue
Knowledge retrieval is one of the major challenges in building a knowledge-grounded dialogue system. A common method is to use a neural retriever with a distributed approximate nearest-neighbor database to quickly find the relevant knowledge sentences. In this work, we propose an approach that utilizes topic modeling on the knowledge base to further improve retrieval accuracy and as a result, improve response generation. Additionally, we experiment with a large language model, ChatGPT, to take advantage of the improved retrieval performance to further improve the generation results. Experimental results on two datasets show that our approach can increase retrieval and generation performance. The results also indicate that ChatGPT is a better response generator for knowledge-grounded dialogue when relevant knowledge is provided.
Code (1)
Tasks
Language ModelingLanguage ModellingLarge Language ModelResponse GenerationRetrievalMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Enhancing Retrieval-Augmented Generation with Topic-Enriched Embeddings: A Hybrid Approach Integrating Traditional NLP Techniques
Retrieval-augmented generation (RAG) systems rely on accurate document retrieval to ground large language models (LLMs) in external knowledge, yet retrieval quality often degrades in corpora where topics overlap and them…
Dimensionality ReductionIntegration of Knowledge Graph Embedding Into Topic Modeling with Hierarchical Dirichlet Process
Leveraging domain knowledge is an effective strategy for enhancing the quality of inferred low-dimensional representations of documents by topic models. In this paper, we develop \textit{topic modeling with knowledge gra…
Document ClassificationGeneral ClassificationGraph EmbeddingKnowledge Graph Embedding+2Neural Topic Modeling with Continual Lifelong Learning
Lifelong learning has recently attracted attention in building machine learning systems that continually accumulate and transfer knowledge to help future learning. Unsupervised topic modeling has been popularly used to d…
Data AugmentationInformation RetrievalLifelong learningRetrieval+1Source-LDA: Enhancing probabilistic topic models using prior knowledge sources
A popular approach to topic modeling involves extracting co-occurring n-grams of a corpus into semantic themes. The set of n-grams in a theme represents an underlying topic, but most topic modeling approaches are not abl…
Topic ModelsRetrieval Augmented Generation for Topic Modeling in Organizational Research: An Introduction with Empirical Demonstration
Analyzing textual data is the cornerstone of qualitative research. While traditional methods such as grounded theory and content analysis are widely used, they are labor-intensive and time-consuming. Topic modeling offer…
RAGRetrievalRetrieval-augmented Generation