Diversify Question Generation with Retrieval-Augmented Style Transfer
Given a textual passage and an answer, humans are able to ask questions with various expressions, but this ability is still challenging for most question generation (QG) systems. Existing solutions mainly focus on the internal knowledge within the given passage or the semantic word space for diverse content planning. These methods, however, have not considered the potential of external knowledge for expression diversity. To bridge this gap, we propose RAST, a framework for Retrieval-Augmented Style Transfer, where the objective is to utilize the style of diverse templates for question generation. For training RAST, we develop a novel Reinforcement Learning (RL) based approach that maximizes a weighted combination of diversity reward and consistency reward. Here, the consistency reward is computed by a Question-Answering (QA) model, whereas the diversity reward measures how much the final output mimics the retrieved template. Experimental results show that our method outperforms previous diversity-driven baselines on diversity while being comparable in terms of consistency scores. Our code is available at https://github.com/gouqi666/RAST.
Code (1)
Tasks
DiversityQuestion AnsweringQuestion GenerationQuestion-GenerationReinforcement Learning (RL)RetrievalStyle TransferMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Diversify-verify-adapt: Efficient and Robust Retrieval-Augmented Ambiguous Question Answering
The retrieval augmented generation (RAG) framework addresses an ambiguity in user queries in QA systems by retrieving passages that cover all plausible interpretations and generating comprehensive responses based on the …
Question AnsweringRAGRetrievalRetrieval-augmented GenerationOptimizing open-domain question answering with graph-based retrieval augmented generation
In this work, we benchmark various graph-based retrieval-augmented generation (RAG) systems across a broad spectrum of query types, including OLTP-style (fact-based) and OLAP-style (thematic) queries, to address the comp…
BenchmarkingLanguage ModelingLanguage ModellingOpen-Domain Question Answering+4AsthmaBot: Multi-modal, Multi-Lingual Retrieval Augmented Generation For Asthma Patient Support
Asthma rates have risen globally, driven by environmental and lifestyle factors. Access to immediate medical care is limited, particularly in developing countries, necessitating automated support systems. Large Language …
HallucinationQuestion AnsweringRetrievalRetrieval-augmented GenerationSynthetic Multimodal Question Generation
Multimodal Retrieval Augmented Generation (MMRAG) is a powerful approach to question-answering over multimodal documents. A key challenge with evaluating MMRAG is the paucity of high-quality datasets matching the questio…
Language ModelingLanguage ModellingLarge Language ModelQuestion Answering+5Align Documents to Questions: Question-Oriented Document Rewriting for Retrieval-Augmented Generation
Retrieval-Augmented Generation (RAG) enhances the factuality of Large Language Models (LLMs) by incorporating retrieved documents and/or generated context. However, LLMs often exhibit a stylistic bias when presented with…