paper-with-me

홈 › Papers

Adapting Open Domain Fact Extraction and Verification to COVID-FACT through In-Domain Language Modeling

2020-11-01 · Findings of the Association for Computational Linguistics 2020 · Zhenghao Liu, Chenyan Xiong, Zhuyun Dai, Si Sun, Maosong Sun, Zhiyuan Liu

With the epidemic of COVID-19, verifying the scientifically false online information, such as fake news and maliciously fabricated statements, has become crucial. However, the lack of training data in the scientific domain limits the performance of fact verification models. This paper proposes an in-domain language modeling method for fact extraction and verification systems. We come up with SciKGAT to combine the advantages of open-domain literature search, state-of-the-art fact verification systems and in-domain medical knowledge through language modeling. Our experiments on SCIFACT, a dataset of expert-written scientific fact verification, show that SciKGAT achieves 30{\%} absolute improvement on precision. Our analyses show that such improvement thrives from our in-domain language model by picking up more related evidence pieces and accurate fact verification. Our codes and data are released via Github.

📄 PDF Abstract BibTeX

Code (1)

thunlp/KernelGAT 공식 구현 pytorch

Tasks

Fact VerificationLanguage ModelingLanguage Modelling

Similar Papers 제목 키워드 기반

Evidence-based Interpretable Open-domain Fact-checking with Large Language Models

2023-12-10 · Xin Tan, Bowei Zou, Ai Ti Aw

Universal fact-checking systems for real-world claims face significant challenges in gathering valid and sufficient real-time evidence and making reasoned decisions. In this work, we introduce the Open-domain Explainable…

Fact Checkingvalid

IMCI: Integrate Multi-view Contextual Information for Fact Extraction and Verification

2022-08-30 · COLING 2022 10 · Hao Wang, Yangguang Li, Zhen Huang, Yong Dou

With the rapid development of automatic fake news detection technology, fact extraction and verification (FEVER) has been attracting more attention. The task aims to extract the most related fact evidences from millions …

Fake News DetectionSentence

CheckEmbed: Effective Verification of LLM Solutions to Open-Ended Tasks

2024-06-04 · Maciej Besta, Lorenzo Paleari, Ales Kubicek, Piotr Nyczyk 외

Large Language Models (LLMs) are revolutionizing various domains, yet verifying their answers remains a significant challenge, especially for intricate open-ended tasks such as consolidation, summarization, and extractio…

Document SummarizationSentenceTerm Extraction

Joint Verification and Reranking for Open Fact Checking Over Tables

2020-12-30 · ACL 2021 5 · Michael Schlichtkrull, Vladimir Karpukhin, Barlas Oğuz, Mike Lewis 외

Structured information is an important knowledge source for automatic verification of factual claims. Nevertheless, the majority of existing research into this task has focused on textual data, and the few recent inquiri…

Fact CheckingRerankingRetrieval

Growing and Serving Large Open-domain Knowledge Graphs

2023-05-16 · Ihab F. Ilyas, JP Lacerda, Yunyao Li, Umar Farooq Minhas 외

Applications of large open-domain knowledge graphs (KGs) to real-world problems pose many unique challenges. In this paper, we present extensions to Saga our platform for continuous construction and serving of knowledge …

Entity LinkingFact VerificationKnowledge Graph EmbeddingsKnowledge Graphs