Stay Hungry, Stay Focused: Generating Informative and Specific Questions in Information-Seeking Conversations
We investigate the problem of generating informative questions in information-asymmetric conversations. Unlike previous work on question generation which largely assumes knowledge of what the answer might be, we are interested in the scenario where the questioner is not given the context from which answers are drawn, but must reason pragmatically about how to acquire new information, given the shared conversation history. We identify two core challenges: (1) formally defining the informativeness of potential questions, and (2) exploring the prohibitively large space of potential questions to find the good candidates. To generate pragmatic questions, we use reinforcement learning to optimize an informativeness metric we propose, combined with a reward function designed to promote more specific questions. We demonstrate that the resulting pragmatic questioner substantially improves the informativeness and specificity of questions generated over a baseline model, as evaluated by our metrics as well as humans.
Code (1)
Tasks
InformativenessQuestion GenerationQuestion-GenerationReinforcement LearningSpecificitySimilar Papers 제목 키워드 기반
Stay Hungry, Stay Foolish: On the Extended Reading Articles Generation with LLMs
The process of creating educational materials is both time-consuming and demanding for educators. This research explores the potential of Large Language Models (LLMs) to streamline this task by automating the generation …
ArticlesSemantic SimilaritySemantic Textual SimilarityDomain-Specific Corpus Expansion with Focused Webcrawling
This work presents a straightforward method for extending or creating in-domain web corpora by focused webcrawling. The focused webcrawler uses statistical N-gram language models to estimate the relatedness of documents …
PatientNarr: Towards generating patient-centric summaries of hospital stays
Assessing the impact of emergency department short stay units using length-of-stay prediction and discrete event simulation
Accurately predicting hospital length-of-stay at the time a patient is admitted to hospital may help guide clinical decision making and resource allocation. In this study we aim to build a decision support system that pr…
Decision MakingDiagnosticfeature selectionLength-of-Stay predictionUsing Clinical Notes for ICU Management
Monitoring patients in ICU is a challenging and high-cost task. Hence, predicting the condition of patients during their ICU stay can help provide better acute care and plan the hospital's resources. There has been conti…
DecompensationManagementMortality PredictionTime Series+1