Team Papelo at FEVEROUS: Multi-hop Evidence Pursuit
We develop a system for the FEVEROUS fact extraction and verification task that ranks an initial set of potential evidence and then pursues missing evidence in subsequent hops by trying to generate it, with a “next hop prediction module” whose output is matched against page elements in a predicted article. Seeking evidence with the next hop prediction module continues to improve FEVEROUS score for up to seven hops. Label classification is trained on possibly incomplete extracted evidence chains, utilizing hints that facilitate numerical comparison. The system achieves .281 FEVEROUS score and .658 label accuracy on the development set, and finishes in second place with .259 FEVEROUS score and .576 label accuracy on the test set.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Multi-hop Evidence Pursuit Meets the Web: Team Papelo at FEVER 2024
Separating disinformation from fact on the web has long challenged both the search and the reasoning powers of humans. We show that the reasoning power of large language models (LLMs) and the retrieval power of modern se…
Question GenerationQuestion-GenerationThe Fact Extraction and VERification Over Unstructured and Structured information (FEVEROUS) Shared Task
The Fact Extraction and VERification Over Unstructured and Structured information (FEVEROUS) shared task, asks participating systems to determine whether human-authored claims are Supported or Refuted based on evidence r…
RetrievalTeam Papelo: Transformer Networks at FEVER
We develop a system for the FEVER fact extraction and verification challenge that uses a high precision entailment classifier based on transformer networks pretrained with language modeling, to classify a broad set of po…
ArticlesLanguage ModelingLanguage ModellingFaBULOUS: Fact-checking Based on Understanding of Language Over Unstructured and Structured information
As part of the FEVEROUS shared task, we developed a robust and finely tuned architecture to handle the joint retrieval and entailment on text data as well as structured data like tables. We proposed two training schemes …
Fact CheckingRetrievalA Fact Checking and Verification System for FEVEROUS Using a Zero-Shot Learning Approach
In this paper, we propose a novel fact checking and verification system to check claims against Wikipedia content. Our system retrieves relevant Wikipedia pages using Anserini, uses BERT-large-cased question answering mo…
Fact CheckingNatural Language InferenceQuestion AnsweringZero-Shot Learning