paper-with-me

홈 › Papers

Team Alex at CLEF CheckThat! 2020: Identifying Check-Worthy Tweets With Transformer Models

2020-09-07 · Alex Nikolov, Giovanni Da San Martino, Ivan Koychev, Preslav Nakov

While misinformation and disinformation have been thriving in social media for years, with the emergence of the COVID-19 pandemic, the political and the health misinformation merged, thus elevating the problem to a whole new level and giving rise to the first global infodemic. The fight against this infodemic has many aspects, with fact-checking and debunking false and misleading claims being among the most important ones. Unfortunately, manual fact-checking is time-consuming and automatic fact-checking is resource-intense, which means that we need to pre-filter the input social media posts and to throw out those that do not appear to be check-worthy. With this in mind, here we propose a model for detecting check-worthy tweets about COVID-19, which combines deep contextualized text representations with modeling the social context of the tweet. We further describe a number of additional experiments and comparisons, which we believe should be useful for future research as they provide some indication about what techniques are effective for the task. Our official submission to the English version of CLEF-2020 CheckThat! Task 1, system Team_Alex, was ranked second with a MAP score of 0.8034, which is almost tied with the wining system, lagging behind by just 0.003 MAP points absolute.

📄 PDF Abstract BibTeX arXiv:2009.02931

Code (3)

BinWang28/BERT_Sentence_Embedding pytorch
BinWang28/SBERT-WK-Sentence-Embedding pytorch
LiamMaclean216/Pytorch-Transfomer pytorch

Tasks

Fact CheckingMisinformation

Similar Papers 제목 키워드 기반

DS@GT at CheckThat! 2025: Exploring Retrieval and Reranking Pipelines for Scientific Claim Source Retrieval on Social Media Discourse

2025-07-09 · Jeanette Schofield, Shuyu Tian, Hoang Thanh Thanh Truong, Maximilian Heil arxiv

Social media users often make scientific claims without citing where these claims come from, generating a need to verify these claims. This paper details work done by the DS@GT team for CLEF 2025 CheckThat! Lab Task 4b S…

Data Augmentation

Overview of the CLEF--2021 CheckThat! Lab on Detecting Check-Worthy Claims, Previously Fact-Checked Claims, and Fake News

2021-09-23 · Preslav Nakov, Giovanni Da San Martino, Tamer Elsayed, Alberto Barrón-Cedeño 외

We describe the fourth edition of the CheckThat! Lab, part of the 2021 Conference and Labs of the Evaluation Forum (CLEF). The lab evaluates technology supporting tasks related to factuality, and covers Arabic, Bulgarian…

Fact CheckingTask 2

Overview of CheckThat! 2020: Automatic Identification and Verification of Claims in Social Media

2020-07-15 · Alberto Barron-Cedeno, Tamer Elsayed, Preslav Nakov, Giovanni Da San Martino 외

We present an overview of the third edition of the CheckThat! Lab at CLEF 2020. The lab featured five tasks in two different languages: English and Arabic. The first four tasks compose the full pipeline of claim verifica…

Claim VerificationRetrievalTask 2

DS@GT at CheckThat! 2025: Ensemble Methods for Detection of Scientific Discourse on Social Media

2025-07-08 · Ayush Parikh, Hoang Thanh Thanh Truong, Jeanette Schofield, Maximilian Heil

In this paper, we, as the DS@GT team for CLEF 2025 CheckThat! Task 4a Scientific Web Discourse Detection, present the methods we explored for this task. For this multiclass classification task, we determined if a tweet c…

ARC

Fraunhofer SIT at CheckThat! 2023: Tackling Classification Uncertainty Using Model Souping on the Example of Check-Worthiness Classification

2023-07-03 · Raphael Frick, Inna Vogel, Jeong-Eun Choi

This paper describes the second-placed approach developed by the Fraunhofer SIT team in the CLEF-2023 CheckThat! lab Task 1B for English. Given a text snippet from a political debate, the aim of this task is to determine…

ClassificationFact Checking