DeFactoNLP: Fact Verification using Entity Recognition, TFIDF Vector Comparison and Decomposable Attention
In this paper, we describe DeFactoNLP, the system we designed for the FEVER 2018 Shared Task. The aim of this task was to conceive a system that can not only automatically assess the veracity of a claim but also retrieve evidence supporting this assessment from Wikipedia. In our approach, the Wikipedia documents whose Term Frequency-Inverse Document Frequency (TFIDF) vectors are most similar to the vector of the claim and those documents whose names are similar to those of the named entities (NEs) mentioned in the claim are identified as the documents which might contain evidence. The sentences in these documents are then supplied to a textual entailment recognition module. This module calculates the probability of each sentence supporting the claim, contradicting the claim or not providing any relevant information to assess the veracity of the claim. Various features computed using these probabilities are finally used by a Random Forest classifier to determine the overall truthfulness of the claim. The sentences which support this classification are returned as evidence. Our approach achieved a 0.4277 evidence F1-score, a 0.5136 label accuracy and a 0.3833 FEVER score.
Code (1)
Tasks
Fact VerificationNatural Language InferenceSentenceSimilar Papers 제목 키워드 기반
Two-Factor Biometric Verification with ECG: Two Cancelable Approaches
Biometric authentication relies on an individual's physiological or behavioral traits to verify their identity before granting access permission to a system or device without remembering anything. Although electrocardiog…
Vocal Bursts Valence PredictionSIRIUS-LTG: An Entity Linking Approach to Fact Extraction and Verification
This article presents the SIRIUS-LTG system for the Fact Extraction and VERification (FEVER) Shared Task. It consists of three components: 1) \textit{Wikipedia Page Retrieval}: First we extract the entities in the claim,…
Entity LinkingInformation RetrievalNatural Language InferenceQuestion Answering+2Training face verification models from generated face identity data
Machine learning tools are becoming increasingly powerful and widely used. Unfortunately membership attacks, which seek to uncover information from data sets used in machine learning, have the potential to limit data sha…
BIG-bench Machine LearningFace RecognitionFace VerificationGenerative Adversarial Network+1Mitigating Longitudinal Performance Degradation in Child Face Recognition Using Synthetic Data
Longitudinal face recognition in children remains challenging due to rapid and nonlinear facial growth, which causes template drift and increasing verification errors over time. This work investigates whether synthetic f…
Face RecognitionModeling Entity Knowledge for Fact Verification
Fact verification is a challenging task of identifying the truthfulness of given claims based on the retrieval of relevant evidence texts. Many claims require understanding and reasoning over external entity information …
DescriptiveFact VerificationRetrieval