QuestGen: Effectiveness of Question Generation Methods for Fact-Checking Applications
Verifying fact-checking claims poses a significant challenge, even for humans. Recent approaches have demonstrated that decomposing claims into relevant questions to gather evidence enhances the efficiency of the fact-checking process. In this paper, we provide empirical evidence showing that this question decomposition can be effectively automated. We demonstrate that smaller generative models, fine-tuned for the question generation task using data augmentation from various datasets, outperform large language models by up to 8%. Surprisingly, in some cases, the evidence retrieved using machine-generated questions proves to be significantly more effective for fact-checking than that obtained from human-written questions. We also perform manual evaluation of the decomposed questions to assess the quality of the questions generated.
Code (1)
Tasks
Data AugmentationFact CheckingQuestion GenerationQuestion-GenerationSimilar Papers 제목 키워드 기반
Reinforced Multi-task Approach for Multi-hop Question Generation
Question generation (QG) attempts to solve the inverse of question answering (QA) problem by generating a natural language question given a document and an answer. While sequence to sequence neural models surpass rule-ba…
Multi-hop Question AnsweringQuestion AnsweringQuestion GenerationQuestion-Generation+2PolyG: Effective and Efficient GraphRAG with Adaptive Graph Traversal
GraphRAG enhances large language models (LLMs) to generate quality answers for user questions by retrieving related facts from external knowledge graphs. Existing GraphRAG methods adopt a fixed graph traversal strategy f…
Knowledge GraphsRead before Generate! Faithful Long Form Question Answering with Machine Reading
Long-form question answering (LFQA) aims to generate a paragraph-length answer for a given question. While current work on LFQA using large pre-trained model for generation are effective at producing fluent and somewhat …
Answer GenerationFormLong Form Question AnsweringQuestion Answering+1TriviaHG: A Dataset for Automatic Hint Generation from Factoid Questions
Nowadays, individuals tend to engage in dialogues with Large Language Models, seeking answers to their questions. In times when such answers are readily accessible to anyone, the stimulation and preservation of human's c…
Hint GenerationInformation RetrievalLarge Language ModelQuestion AnsweringA Multi-label Multi-hop Relation Detection Model based on Relation-aware Sequence Generation
Multi-hop relation detection in Knowledge Base Question Answering (KBQA) aims at retrieving the relation path starting from the topic entity to the answer node based on a given question, where the relation path may compr…
Knowledge Base Question AnsweringMulti-Label LearningQuestion AnsweringRelation