홈 › Papers

Overview of the CLEF--2021 CheckThat! Lab on Detecting Check-Worthy Claims, Previously Fact-Checked Claims, and Fake News

2021-09-23 · Preslav Nakov, Giovanni Da San Martino, Tamer Elsayed, Alberto Barrón-Cedeño, Rubén Míguez, Shaden Shaar, Firoj Alam, Fatima Haouari, Maram Hasanain, Watheq Mansour, Bayan Hamdan, Zien Sheikh Ali, Nikolay Babulkov, Alex Nikolov, Gautam Kishore Shahi, Julia Maria Struß, Thomas Mandl, Mucahid Kutlu, Yavuz Selim Kartal

We describe the fourth edition of the CheckThat! Lab, part of the 2021 Conference and Labs of the Evaluation Forum (CLEF). The lab evaluates technology supporting tasks related to factuality, and covers Arabic, Bulgarian, English, Spanish, and Turkish. Task 1 asks to predict which posts in a Twitter stream are worth fact-checking, focusing on COVID-19 and politics (in all five languages). Task 2 asks to determine whether a claim in a tweet can be verified using a set of previously fact-checked claims (in Arabic and English). Task 3 asks to predict the veracity of a news article and its topical domain (in English). The evaluation is based on mean average precision or precision at rank k for the ranking tasks, and macro-F1 for the classification tasks. This was the most popular CLEF-2021 lab in terms of team registrations: 132 teams. Nearly one-third of them participated: 15, 5, and 25 teams submitted official runs for tasks 1, 2, and 3, respectively.

📄 PDF Abstract BibTeX arXiv:2109.12987

Code (0)

등록된 구현이 없습니다.

Tasks

Fact CheckingTask 2

Team Alex at CLEF CheckThat! 2020: Identifying Check-Worthy Tweets With Transformer Models

2020-09-07 · Alex Nikolov, Giovanni Da San Martino, Ivan Koychev, Preslav Nakov

While misinformation and disinformation have been thriving in social media for years, with the emergence of the COVID-19 pandemic, the political and the health misinformation merged, thus elevating the problem to a whole…

Fact Checking Misinformation

Overview of the CLEF-2019 CheckThat!: Automatic Identification and Verification of Claims

2021-09-25 · Tamer Elsayed, Preslav Nakov, Alberto Barrón-Cedeño, Maram Hasanain 외

We present an overview of the second edition of the CheckThat! Lab at CLEF 2019. The lab featured two tasks in two different languages: English and Arabic. Task 1 (English) challenged the participating systems to predict…

Claim Verification Fact Checking Learning-To-Rank Task 2

Fraunhofer SIT at CheckThat! 2023: Tackling Classification Uncertainty Using Model Souping on the Example of Check-Worthiness Classification

2023-07-03 · Raphael Frick, Inna Vogel, Jeong-Eun Choi

This paper describes the second-placed approach developed by the Fraunhofer SIT team in the CLEF-2023 CheckThat! lab Task 1B for English. Given a text snippet from a political debate, the aim of this task is to determine…

Classification Fact Checking

UPV at CheckThat! 2021: Mitigating Cultural Differences for Identifying Multilingual Check-worthy Claims

2021-09-19 · Ipek Baris Schlicht, Angel Felipe Magnossão de Paula, Paolo Rosso

Identifying check-worthy claims is often the first step of automated fact-checking systems. Tackling this task in a multilingual setting has been understudied. Encoding inputs with multilingual text representations could…

Fact Checking Language Identification

Overview of CheckThat! 2020: Automatic Identification and Verification of Claims in Social Media

2020-07-15 · Alberto Barron-Cedeno, Tamer Elsayed, Preslav Nakov, Giovanni Da San Martino 외

We present an overview of the third edition of the CheckThat! Lab at CLEF 2020. The lab featured five tasks in two different languages: English and Arabic. The first four tasks compose the full pipeline of claim verifica…

Claim Verification Retrieval Task 2