Unsupervised Question Answering for Fact-Checking

2019-10-16 · WS 2019 11 · Mayank Jobanputra

Recent Deep Learning (DL) models have succeeded in achieving human-level accuracy on various natural language tasks such as question-answering, natural language inference (NLI), and textual entailment. These tasks not only require the contextual knowledge but also the reasoning abilities to be solved efficiently. In this paper, we propose an unsupervised question-answering based approach for a similar task, fact-checking. We transform the FEVER dataset into a Cloze-task by masking named entities provided in the claims. To predict the answer token, we utilize pre-trained Bidirectional Encoder Representations from Transformers (BERT). The classifier computes label based on the correctly answered questions and a threshold. Currently, the classifier is able to classify the claims as "SUPPORTS" and "MANUAL_REVIEW". This approach achieves a label accuracy of 80.2% on the development set and 80.25% on the test set of the transformed dataset.

📄 PDF Abstract BibTeX arXiv:1910.07154

Code (0)

등록된 구현이 없습니다.

Tasks

Fact Checking Natural Language Inference Question Answering

Methods 이 논문이 사용한 방법론

Test 설명 없음

Explainable Fact-checking through Question Answering

2021-10-11 · Jing Yang, Didier Vega-Oliveros, Taís Seibt, Anderson Rocha

Misleading or false information has been creating chaos in some places around the world. To mitigate this issue, many researchers have proposed automated fact-checking methods to fight the spread of fake news. However, m…

Decision Making Fact Checking Question Answering

AnswerFact: Fact Checking in Product Question Answering

2020-11-01 · EMNLP 2020 11 · Wenxuan Zhang, Yang Deng, Jing Ma, Wai Lam

Product-related question answering platforms nowadays are widely employed in many E-commerce sites, providing a convenient way for potential customers to address their concerns during online shopping. However, the misinf…

Fact Checking Misinformation Question Answering

SemEval-2019 Task 8: Fact Checking in Community Question Answering Forums

2019-05-25 · SEMEVAL 2019 6 · Tsvetomila Mihaylova, Georgi Karadjov, Pepa Atanasova, Ramy Baly 외

We present SemEval-2019 Task 8 on Fact Checking in Community Question Answering Forums, which features two subtasks. Subtask A is about deciding whether a question asks for factual information vs. an opinion/advice vs. j…

Community Question Answering Fact Checking Question Answering

QACHECK: A Demonstration System for Question-Guided Multi-Hop Fact-Checking

2023-10-11 · Liangming Pan, Xinyuan Lu, Min-Yen Kan, Preslav Nakov

Fact-checking real-world claims often requires complex, multi-step reasoning due to the absence of direct evidence to support or refute them. However, existing fact-checking systems often lack transparency in their decis…