VILLAIN at AVerImaTeC: Verifying Image-Text Claims via Multi-Agent Collaboration
This paper describes VILLAIN, a multimodal fact-checking system that verifies image-text claims through prompt-based multi-agent collaboration. For the AVerImaTeC shared task, VILLAIN employs vision-language model agents across multiple stages of fact-checking. Textual and visual evidence is retrieved from the knowledge store enriched through additional web collection. To identify key information and address inconsistencies among evidence items, modality-specific and cross-modal agents generate analysis reports. In the subsequent stage, question-answer pairs are produced based on these reports. Finally, the Verdict Prediction agent produces the verification outcome based on the image-text claim and the generated question-answer pairs. Our system ranked first on the leaderboard across all evaluation metrics. The source code is publicly available at https://github.com/ssu-humane/VILLAIN.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
The Automatic Verification of Image-Text Claims (AVerImaTeC) Shared Task
The Automatic Verification of Image-Text Claims (AVerImaTeC) shared task aims to advance system development for retrieving evidence and verifying real-world image-text claims. Participants were allowed to either employ e…
AIC CTU@AVerImaTeC: dual-retriever RAG for image-text fact checking
In this paper, we present our 3rd place system in the AVerImaTeC shared task, which combines our last year's retrieval-augmented generation (RAG) pipeline with a reverse image search (RIS) module. Despite its simplicity,…
Image RetrievalFact CheckingHerO at AVeriTeC: The Herd of Open Large Language Models for Verifying Real-World Claims
To tackle the AVeriTeC shared task hosted by the FEVER-24, we introduce a system that only employs publicly available large language models (LLMs) for each step of automated fact-checking, dubbed the Herd of Open LLMs fo…
Fact CheckingLanguage ModelingLanguage ModellingQuestion Generation+2Fact-Checking Meets Fauxtography: Verifying Claims About Images
The recent explosion of false claims in social media and on the Web in general has given rise to a lot of manual fact-checking initiatives. Unfortunately, the number of claims that need to be fact-checked is several orde…
Fact CheckingHeroes, Villains, and Victims, and GPT-3: Automated Extraction of Character Roles Without Training Data
This paper shows how to use large-scale pre-trained language models to extract character roles from narrative texts without training data. Queried with a zero-shot question-answering prompt, GPT-3 can identify the hero, …
ArticlesQuestion Answering