Improving Evidence Retrieval with Claim-Evidence Entailment
Claim verification is challenging because it requires first to find textual evidence and then apply claim-evidence entailment to verify a claim. Previous works evaluate the entailment step based on the retrieved evidence, whereas we hypothesize that the entailment prediction can provide useful signals for evidence retrieval, in the sense that if a sentence supports or refutes a claim, the sentence must be relevant. We propose a novel model that uses the entailment score to express the relevancy. Our experiments verify that leveraging entailment prediction improves ranking multiple pieces of evidence.
Code (0)
등록된 구현이 없습니다.
Tasks
Claim VerificationPredictionRetrievalSentenceSimilar Papers 제목 키워드 기반
SUCEA: Reasoning-Intensive Retrieval for Adversarial Fact-checking through Claim Decomposition and Editing
Automatic fact-checking has recently received more attention as a means of combating misinformation. Despite significant advancements, fact-checking systems based on retrieval-augmented language models still struggle to …
Fact CheckingMisinformationRetrievalFool Me Twice: Entailment from Wikipedia Gamification
We release FoolMeTwice (FM2 for short), a large dataset of challenging entailment pairs collected through a fun multi-player game. Gamification encourages adversarial examples, drastically lowering the number of examples…
RetrievalWiCE: Real-World Entailment for Claims in Wikipedia
Textual entailment models are increasingly applied in settings like fact-checking, presupposition verification in question answering, or summary evaluation. However, these represent a significant domain shift from existi…
Fact CheckingNatural Language InferenceQuestion AnsweringRetrieval+1TwoWingOS: A Two-Wing Optimization Strategy for Evidential Claim Verification
Determining whether a given claim is supported by evidence is a fundamental NLP problem that is best modeled as Textual Entailment. However, given a large collection of text, finding evidence that could support or refute…
Claim VerificationNatural Language InferenceVocal Bursts Valence PredictionIntegrating Entity Linking and Evidence Ranking for Fact Extraction and Verification
We describe here our system and results on the FEVER shared task. We prepared a pipeline system which composes of a document selection, a sentence retrieval, and a recognizing textual entailment (RTE) components. A simpl…
Entity LinkingNatural Language InferenceRetrievalRTE+2