Aggregating Pairwise Semantic Differences for Few-Shot Claim Veracity Classification
As part of an automated fact-checking pipeline, the claim veracity classification task consists in determining if a claim is supported by an associated piece of evidence. The complexity of gathering labelled claim-evidence pairs leads to a scarcity of datasets, particularly when dealing with new domains. In this paper, we introduce SEED, a novel vector-based method to few-shot claim veracity classification that aggregates pairwise semantic differences for claim-evidence pairs. We build on the hypothesis that we can simulate class representative vectors that capture average semantic differences for claim-evidence pairs in a class, which can then be used for classification of new instances. We compare the performance of our method with competitive baselines including fine-tuned BERT/RoBERTa models, as well as the state-of-the-art few-shot veracity classification method that leverages language model perplexity. Experiments conducted on the FEVER and SCIFACT datasets show consistent improvements over competitive baselines in few-shot settings. Our code is available.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationFact CheckingLanguage ModelingLanguage ModellingVeracity ClassificationSimilar Papers 제목 키워드 기반
Aggregating Pairwise Semantic Differences for Few-Shot Claim Veracity Classification
As part of an automated fact-checking pipeline, the claim veracity classification task consists in determining if a claim is supported by an associated piece of evidence. The complexity of gathering labelled claim-eviden…
ClassificationFact CheckingLanguage ModelingLanguage Modelling+1MAPLE: Micro Analysis of Pairwise Language Evolution for Few-Shot Claim Verification
Claim verification is an essential step in the automated fact-checking pipeline which assesses the veracity of a claim against a piece of evidence. In this work, we explore the potential of few-shot claim verification, w…
Claim VerificationFact CheckingTopic-Aware Evidence Reasoning and Stance-Aware Aggregation for Fact Verification
Fact verification is a challenging task that requires simultaneously reasoning and aggregating over multiple retrieved pieces of evidence to evaluate the truthfulness of a claim. Existing approaches typically (i) explore…
Fact VerificationSemantic SimilaritySemantic Textual SimilarityCascade-CLIP: Cascaded Vision-Language Embeddings Alignment for Zero-Shot Semantic Segmentation
Pre-trained vision-language models, e.g., CLIP, have been successfully applied to zero-shot semantic segmentation. Existing CLIP-based approaches primarily utilize visual features from the last layer to align with text e…
SegmentationSemantic SegmentationZero-Shot Semantic SegmentationClaimDiff-RL: Fine-Grained Caption Reinforcement Learning through Visual Claim Comparison
Long-form image captioning exposes a reward granularity problem in RL: captions are judged as whole sequences, while the important errors occur at the level of individual visual claims. A good dense caption should be bot…
Reinforcement LearningScene RecognitionImage CaptioningObject Counting