paper-with-me

홈 › Papers

DS@GT at CheckThat! 2025: A Simple Retrieval-First, LLM-Backed Framework for Claim Normalization

2025-08-24 · Aleksandar Pramov, Jiangqin Ma, Bina Patel arxiv

Claim normalization is an integral part of any automatic fact-check verification system. It parses the typically noisy claim data, such as social media posts into normalized claims, which are then fed into downstream veracity classification tasks. The CheckThat! 2025 Task 2 focuses specifically on claim normalization and spans 20 languages under monolingual and zero-shot conditions. Our proposed solution consists of a lightweight \emph{retrieval-first, LLM-backed} pipeline, in which we either dynamically prompt a GPT-4o-mini with in-context examples, or retrieve the closest normalization from the train dataset directly. On the official test set, the system ranks near the top for most monolingual tracks, achieving first place in 7 out of of the 13 languages. In contrast, the system underperforms in the zero-shot setting, highlighting the limitation of the proposed solution.

📄 PDF Abstract BibTeX arXiv:2508.17402

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

DS@GT at CheckThat! 2025: Exploring Retrieval and Reranking Pipelines for Scientific Claim Source Retrieval on Social Media Discourse

2025-07-09 · Jeanette Schofield, Shuyu Tian, Hoang Thanh Thanh Truong, Maximilian Heil arxiv

Social media users often make scientific claims without citing where these claims come from, generating a need to verify these claims. This paper details work done by the DS@GT team for CLEF 2025 CheckThat! Lab Task 4b S…

Data Augmentation

AIRwaves at CheckThat! 2025: Retrieving Scientific Sources for Implicit Claims on Social Media with Dual Encoders and Neural Re-Ranking

2025-09-23 · Cem Ashbaugh, Leon Baumgärtner, Tim Gress, Nikita Sidorov 외 arxiv

Linking implicit scientific claims made on social media to their original publications is crucial for evidence-based fact-checking and scholarly discourse, yet it is hindered by lexical sparsity, very short queries, and …

The CLEF-2026 CheckThat! Lab: Advancing Multilingual Fact-Checking

2026-02-10 · Julia Maria Struß, Sebastian Schellhammer, Stefan Dietze, Venktesh V 외 arxiv

The CheckThat! lab aims to advance the development of innovative technologies combating disinformation and manipulation efforts in online communication across a multitude of languages and platforms. While in early editio…

Deep Retrieval at CheckThat! 2025: Identifying Scientific Papers from Implicit Social Media Mentions via Hybrid Retrieval and Re-Ranking

2025-05-29 · Pascal J. Sager, Ashwini Kamaraj, Benjamin F. Grewe, Thilo Stadelmann

We present the methodology and results of the Deep Retrieval team for subtask 4b of the CLEF CheckThat! 2025 competition, which focuses on retrieving relevant scientific literature for given social media posts. To addres…

Large Language ModelRe-RankingRetrievalSemantic Retrieval

DS@GT at CheckThat! 2025: Evaluating Context and Tokenization Strategies for Numerical Fact Verification

2025-07-08 · Maximilian Heil, Aleksandar Pramov

Numerical claims, statements involving quantities, comparisons, and temporal references, pose unique challenges for automated fact-checking systems. In this study, we evaluate modeling strategies for veracity prediction …

ARCArithmetic ReasoningFact CheckingFact Verification+1