paper-with-me

Papers

WikiContradiction: Detecting Self-Contradiction Articles on Wikipedia

2021-11-16 · Cheng Hsu, Cheng-Te Li, Diego Saez-Trumper, Yi-Zhan Hsu

While Wikipedia has been utilized for fact-checking and claim verification to debunk misinformation and disinformation, it is essential to either improve article quality and rule out noisy articles. Self-contradiction is one of the low-quality article types in Wikipedia. In this work, we propose a task of detecting self-contradiction articles in Wikipedia. Based on the "self-contradictory" template, we create a novel dataset for the self-contradiction detection task. Conventional contradiction detection focuses on comparing pairs of sentences or claims, but self-contradiction detection needs to further reason the semantics of an article and simultaneously learn the contradiction-aware comparison from all pairs of sentences. Therefore, we present the first model, Pairwise Contradiction Neural Network (PCNN), to not only effectively identify self-contradiction articles, but also highlight the most contradiction pairs of contradiction sentences. The main idea of PCNN is two-fold. First, to mitigate the effect of data scarcity on self-contradiction articles, we pre-train the module of pairwise contradiction learning using SNLI and MNLI benchmarks. Second, we select top-K sentence pairs with the highest contradiction probability values and model their correlation to determine whether the corresponding article belongs to self-contradiction. Experiments conducted on the proposed WikiContradiction dataset exhibit that PCNN can generate promising performance and comprehensively highlight the sentence pairs the contradiction locates.

📄 PDF Abstract BibTeX arXiv:2111.08543

Code (1)

wiki-contradictory/wiki-self-contradictory 공식 구현 pytorch

Tasks

ArticlesClaim VerificationFact CheckingMisinformationSentence

Similar Papers 제목 키워드 기반

Hoaxpedia: A Unified Wikipedia Hoax Articles Dataset

2024-05-03 · Hsuvas Borkakoty, Luis Espinosa-Anke

Hoaxes are a recognised form of disinformation created deliberately, with potential serious implications in the credibility of reference knowledge resources such as Wikipedia. What makes detecting Wikipedia hoaxes hard i…

ArticlesBinary ClassificationBinary text classificationtext-classification+1

Language agents achieve superhuman synthesis of scientific knowledge

2024-09-10 · Michael D. Skarlinski, Sam Cox, Jon M. Laurent, James D. Braza 외

Language models are known to hallucinate incorrect information, and it is unclear if they are sufficiently accurate and reliable for use in scientific research. We developed a rigorous human-AI comparison methodology to …

ArticlesInformation RetrievalLanguage ModelingLanguage Modelling

The Rise of AI-Generated Content in Wikipedia

2024-10-10 · Creston Brooks, Samuel Eggert, Denis Peskoff

The rise of AI-generated content in popular information sources raises significant concerns about accountability, accuracy, and bias amplification. Beyond directly impacting consumers, the widespread presence of this con…

Articles

Wiki-Reliability: A Large Scale Dataset for Content Reliability on Wikipedia

2021-05-10 · KayYen Wong, Miriam Redi, Diego Saez-Trumper

Wikipedia is the largest online encyclopedia, used by algorithms and web users as a central hub of reliable information on the web. The quality and reliability of Wikipedia content is maintained by a community of volunte…

ArticlesInformation RetrievalRetrieval

Detecting Corpus-Level Knowledge Inconsistencies in Wikipedia with Large Language Models

2025-09-27 · Sina J. Semnani, Jirayu Burapacheep, Arpandeep Khatua, Thanawan Atchariyachanvanit 외 arxiv

Wikipedia is the largest open knowledge corpus, widely used worldwide and serving as a key resource for training large language models (LLMs) and retrieval-augmented generation (RAG) systems. Ensuring its accuracy is the…