paper-with-me

Papers

QuestGen: Effectiveness of Question Generation Methods for Fact-Checking Applications

2024-07-31 · Ritvik Setty, Vinay Setty

Verifying fact-checking claims poses a significant challenge, even for humans. Recent approaches have demonstrated that decomposing claims into relevant questions to gather evidence enhances the efficiency of the fact-checking process. In this paper, we provide empirical evidence showing that this question decomposition can be effectively automated. We demonstrate that smaller generative models, fine-tuned for the question generation task using data augmentation from various datasets, outperform large language models by up to 8%. Surprisingly, in some cases, the evidence retrieved using machine-generated questions proves to be significantly more effective for fact-checking than that obtained from human-written questions. We also perform manual evaluation of the decomposed questions to assess the quality of the questions generated.

📄 PDF Abstract BibTeX arXiv:2407.21441

Code (1)

factiverse/questgen 공식 구현

Tasks

Data AugmentationFact CheckingQuestion GenerationQuestion-Generation

Similar Papers 제목 키워드 기반

Reinforced Multi-task Approach for Multi-hop Question Generation

2020-04-05 · COLING 2020 8 · Deepak Gupta, Hardik Chauhan, Akella Ravi Tej, Asif Ekbal 외

Question generation (QG) attempts to solve the inverse of question answering (QA) problem by generating a natural language question given a document and an answer. While sequence to sequence neural models surpass rule-ba…

Multi-hop Question AnsweringQuestion AnsweringQuestion GenerationQuestion-Generation+2

PolyG: Effective and Efficient GraphRAG with Adaptive Graph Traversal

2025-04-02 · Renjie Liu, Haitian Jiang, Xiao Yan, Bo Tang 외

GraphRAG enhances large language models (LLMs) to generate quality answers for user questions by retrieving related facts from external knowledge graphs. Existing GraphRAG methods adopt a fixed graph traversal strategy f…

Knowledge Graphs

Read before Generate! Faithful Long Form Question Answering with Machine Reading

2022-03-01 · Findings (ACL) 2022 5 · Dan Su, Xiaoguang Li, Jindi Zhang, Lifeng Shang 외

Long-form question answering (LFQA) aims to generate a paragraph-length answer for a given question. While current work on LFQA using large pre-trained model for generation are effective at producing fluent and somewhat …

Answer GenerationFormLong Form Question AnsweringQuestion Answering+1

TriviaHG: A Dataset for Automatic Hint Generation from Factoid Questions

2024-03-27 · Jamshid Mozafari, Anubhav Jangra, Adam Jatowt

Nowadays, individuals tend to engage in dialogues with Large Language Models, seeking answers to their questions. In times when such answers are readily accessible to anyone, the stimulation and preservation of human's c…

Hint GenerationInformation RetrievalLarge Language ModelQuestion Answering

A Multi-label Multi-hop Relation Detection Model based on Relation-aware Sequence Generation

2021-11-01 · Findings (EMNLP) 2021 11 · Linhai Zhang, Deyu Zhou, Chao Lin, Yulan He

Multi-hop relation detection in Knowledge Base Question Answering (KBQA) aims at retrieving the relation path starting from the topic entity to the answer node based on a given question, where the relation path may compr…

Knowledge Base Question AnsweringMulti-Label LearningQuestion AnsweringRelation