Aggregating Pairwise Semantic Differences for Few-Shot Claim Veracity Classification
As part of an automated fact-checking pipeline, the claim veracity classification task consists in determining if a claim is supported by an associated piece of evidence. The complexity of gathering labelled claim-evidence pairs leads to a scarcity of datasets, particularly when dealing with new domains. In this paper, we introduce SEED, a novel vector-based method to few-shot claim veracity classification that aggregates pairwise semantic differences for claim-evidence pairs. We build on the hypothesis that we can find class representative vectors that capture average semantic differences for claim-evidence pairs in a class, which can then be used for classification of new instances. We compare the performance of our method with competitive baselines including fine-tuned BERT/RoBERTa models, as well as the state-of-the-art few-shot veracity classification method that leverages language model perplexity. Experiments conducted on the FEVER and SCIFACT datasets show consistent improvements over competitive baselines in few-shot settings. Our code will be made publicly available upon publication.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationFact CheckingLanguage ModelingLanguage ModellingVeracity ClassificationSimilar Papers 제목 키워드 기반
Aggregating Pairwise Semantic Differences for Few-Shot Claim Veracity Classification
As part of an automated fact-checking pipeline, the claim veracity classification task consists in determining if a claim is supported by an associated piece of evidence. The complexity of gathering labelled claim-eviden…
ClassificationFact CheckingLanguage ModelingLanguage Modelling+1MAPLE: Micro Analysis of Pairwise Language Evolution for Few-Shot Claim Verification
Claim verification is an essential step in the automated fact-checking pipeline which assesses the veracity of a claim against a piece of evidence. In this work, we explore the potential of few-shot claim verification, w…
Claim VerificationFact CheckingTopic-Aware Evidence Reasoning and Stance-Aware Aggregation for Fact Verification
Fact verification is a challenging task that requires simultaneously reasoning and aggregating over multiple retrieved pieces of evidence to evaluate the truthfulness of a claim. Existing approaches typically (i) explore…
Fact VerificationSemantic SimilaritySemantic Textual SimilarityCascade-CLIP: Cascaded Vision-Language Embeddings Alignment for Zero-Shot Semantic Segmentation
Pre-trained vision-language models, e.g., CLIP, have been successfully applied to zero-shot semantic segmentation. Existing CLIP-based approaches primarily utilize visual features from the last layer to align with text e…
SegmentationSemantic SegmentationZero-Shot Semantic SegmentationClaimDiff-RL: Fine-Grained Caption Reinforcement Learning through Visual Claim Comparison
Long-form image captioning exposes a reward granularity problem in RL: captions are judged as whole sequences, while the important errors occur at the level of individual visual claims. A good dense caption should be bot…
Reinforcement LearningScene RecognitionImage CaptioningObject Counting