Table Fact Verification with Structure-Aware Transformer
Verifying fact on semi-structured evidence like tables requires the ability to encode structural information and perform symbolic reasoning. Pre-trained language models trained on natural language could not be directly applied to encode tables, because simply linearizing tables into sequences will lose the cell alignment information. To better utilize pre-trained transformers for table representation, we propose a Structure-Aware Transformer (SAT), which injects the table structural information into the mask of the self-attention layer. A method to combine symbolic and linguistic reasoning is also explored for this task. Our method outperforms baseline with 4.93{\%} on TabFact, a large scale table verification dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
Fact VerificationSimilar Papers 제목 키워드 기반
Co-Sight: Enhancing LLM-Based Agents via Conflict-Aware Meta-Verification and Trustworthy Reasoning with Structured Facts
Long-horizon reasoning in LLM-based agents often fails not from generative weakness but from insufficient verification of intermediate reasoning. Co-Sight addresses this challenge by turning reasoning into a falsifiable …
Learning to Generate Programs for Table Fact Verification via Structure-Aware Semantic Parsing
Table fact verification aims to check the correctness of textual statements based on given semi-structured data. Most existing methods are devoted to better comprehending logical operations and tables, but they hardly st…
Fact VerificationSemantic ParsingStructural Encoding and Pre-training Matter: Adapting BERT for Table-Based Fact Verification
Growing concern with online misinformation has encouraged NLP research on fact verification. Since writers often base their assertions on structured data, we focus here on verifying textual statements given evidence in t…
Fact VerificationGraph Neural NetworkLanguage ModelingLanguage Modelling+5Table-based Fact Verification with Salience-aware Learning
Tables provide valuable knowledge that can be used to verify textual statements. While a number of works have considered table-based fact verification, direct alignments of tabular data with tokens in textual statements …
counterfactualData AugmentationFact VerificationTable-based Fact VerificationPASTA: Table-Operations Aware Fact Verification via Sentence-Table Cloze Pre-training
Fact verification has attracted a lot of research attention recently, e.g., in journalism, marketing, and policymaking, as misinformation and disinformation online can sway one's opinion and affect one's actions. While f…
Fact CheckingFact VerificationLanguage ModellingMarketing+3