The Fact Extraction and VERification (FEVER) Shared Task

2018-11-27 · WS 2018 11 · James Thorne, Andreas Vlachos, Oana Cocarascu, Christos Christodoulopoulos, Arpit Mittal

We present the results of the first Fact Extraction and VERification (FEVER) Shared Task. The task challenged participants to classify whether human-written factoid claims could be Supported or Refuted using evidence retrieved from Wikipedia. We received entries from 23 competing teams, 19 of which scored higher than the previously published baseline. The best performing system achieved a FEVER score of 64.21%. In this paper, we present the results of the shared task and a summary of the systems, highlighting commonalities and innovations among participating systems.

📄 PDF Abstract BibTeX arXiv:1811.10971

Code (0)

등록된 구현이 없습니다.

Verdict Inference with Claim and Retrieved Elements Using RoBERTa

2021-11-01 · EMNLP (FEVER) 2021 11 · In-Zu Gi, Ting-Yu Fang, Richard Tzong-Han Tsai

Automatic fact verification has attracted recent research attention as the increasing dissemination of disinformation on social media platforms. The FEVEROUS shared task introduces a benchmark for fact verification, in w…

Fact Verification Retrieval

The Fact Extraction and VERification Over Unstructured and Structured information (FEVEROUS) Shared Task

2021-11-01 · EMNLP (FEVER) 2021 11 · Rami Aly, Zhijiang Guo, Michael Sejr Schlichtkrull, James Thorne 외

The Fact Extraction and VERification Over Unstructured and Structured information (FEVEROUS) shared task, asks participating systems to determine whether human-authored claims are Supported or Refuted based on evidence r…

Retrieval

QED: A fact verification system for the FEVER shared task

2018-11-01 · WS 2018 11 · Jackson Luken, Nanjiang Jiang, Marie-Catherine de Marneffe

This paper describes our system submission to the 2018 Fact Extraction and VERification (FEVER) shared task. The system uses a heuristics-based approach for evidence extraction and a modified version of the inference mod…

Fact Verification General Classification Retrieval

Adversarial attacks against Fact Extraction and VERification

2019-03-13 · James Thorne, Andreas Vlachos

This paper describes a baseline for the second iteration of the Fact Extraction and VERification shared task (FEVER2.0) which explores the resilience of systems through adversarial evaluation. We present a collection of …

Fact Checking Information Retrieval Natural Language Inference Retrieval

UKP-Athene: Multi-Sentence Textual Entailment for Claim Verification

2018-09-03 · WS 2018 11 · Andreas Hanselowski, Hao Zhang, Zile Li, Daniil Sorokin 외

The Fact Extraction and VERification (FEVER) shared task was launched to support the development of systems able to verify claims by extracting supporting or refuting facts from raw text. The shared task organizers provi…

Claim Verification Entity Linking General Classification Natural Language Inference+2