paper-with-me

홈 › Papers

An Entity-based Claim Extraction Pipeline for Real-world Biomedical Fact-checking

2023-04-11 · Amelie Wührl, Lara Grimminger, Roman Klinger

Existing fact-checking models for biomedical claims are typically trained on synthetic or well-worded data and hardly transfer to social media content. This mismatch can be mitigated by adapting the social media input to mimic the focused nature of common training claims. To do so, Wuehrl & Klinger (2022) propose to extract concise claims based on medical entities in the text. However, their study has two limitations: First, it relies on gold-annotated entities. Therefore, its feasibility for a real-world application cannot be assessed since this requires detecting relevant entities automatically. Second, they represent claim entities with the original tokens. This constitutes a terminology mismatch which potentially limits the fact-checking performance. To understand both challenges, we propose a claim extraction pipeline for medical tweets that incorporates named entity recognition and terminology normalization via entity linking. We show that automatic NER does lead to a performance drop in comparison to using gold annotations but the fact-checking performance still improves considerably over inputting the unchanged tweets. Normalizing entities to their canonical forms does, however, not improve the performance.

📄 PDF Abstract BibTeX arXiv:2304.05268

Code (0)

등록된 구현이 없습니다.

Tasks

Entity LinkingFact Checkingnamed-entity-recognitionNamed Entity RecognitionNER

Similar Papers 제목 키워드 기반

UKP-Athene: Multi-Sentence Textual Entailment for Claim Verification

2018-09-03 · WS 2018 11 · Andreas Hanselowski, Hao Zhang, Zile Li, Daniil Sorokin 외

The Fact Extraction and VERification (FEVER) shared task was launched to support the development of systems able to verify claims by extracting supporting or refuting facts from raw text. The shared task organizers provi…

Claim VerificationEntity LinkingGeneral ClassificationNatural Language Inference+2

Integrating Entity Linking and Evidence Ranking for Fact Extraction and Verification

2018-11-01 · WS 2018 11 · Motoki Taniguchi, Tomoki Taniguchi, Takumi Takahashi, Yasuhide Miura 외

We describe here our system and results on the FEVER shared task. We prepared a pipeline system which composes of a document selection, a sentence retrieval, and a recognizing textual entailment (RTE) components. A simpl…

Entity LinkingNatural Language InferenceRetrievalRTE+2

Rethinking the Evaluation of Pre-trained Text-and-Layout Models from an Entity-Centric Perspective

2024-02-04 · Chong Zhang, Yixi Zhao, Chenshu Yuan, Yi Tu 외

Recently developed pre-trained text-and-layout models (PTLMs) have shown remarkable success in multiple information extraction tasks on visually-rich documents. However, the prevailing evaluation pipeline may not be suff…

Entity LinkingSemantic entity labeling

Knowledge Extraction From Texts Based on Wikidata

2022-07-01 · NAACL (ACL) 2022 7 · Anastasia Shimorina, Johannes Heinecke, Frédéric Herledan

This paper presents an effort within our company of developing knowledge extraction pipeline for English, which can be further used for constructing an entreprise-specific knowledge base. We present a system consisting o…

coreference-resolutionCoreference ResolutionRelationRelation Extraction

Enoki: Efficient Multi-Level Hallucination Detection

2026-09-01 · Elisei Rykov, Timur Ionov, Nikolay Ivanov, Maksim Savkin 외 arxiv

Ensuring factuality remains a critical challenge for deploying LLMs in high-stakes settings. Existing hallucination detectors usually operate at a single level: claim-level methods provide interpretable factual units, wh…

Open Information Extraction