paper-with-me

홈 › Papers

Team Papelo: Transformer Networks at FEVER

2019-01-08 · WS 2018 11 · Christopher Malon

We develop a system for the FEVER fact extraction and verification challenge that uses a high precision entailment classifier based on transformer networks pretrained with language modeling, to classify a broad set of potential evidence. The precision of the entailment classifier allows us to enhance recall by considering every statement from several articles to decide upon each claim. We include not only the articles best matching the claim text by TFIDF score, but read additional articles whose titles match named entities and capitalized expressions occurring in the claim text. The entailment module evaluates potential evidence one statement at a time, together with the title of the page the evidence came from (providing a hint about possible pronoun antecedents). In preliminary evaluation, the system achieves .5736 FEVER score, .6108 label accuracy, and .6485 evidence F1 on the FEVER shared task test set.

📄 PDF Abstract BibTeX arXiv:1901.02534

Code (1)

cdmalon/finetune-transformer-lm 공식 구현 tf

Tasks

ArticlesLanguage ModelingLanguage Modelling

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Residual Connection 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…

Similar Papers 제목 키워드 기반

Team Papelo at FEVEROUS: Multi-hop Evidence Pursuit

2021-11-01 · EMNLP (FEVER) 2021 11 · Christopher Malon

We develop a system for the FEVEROUS fact extraction and verification task that ranks an initial set of potential evidence and then pursues missing evidence in subsequent hops by trying to generate it, with a “next hop p…

Multi-hop Evidence Pursuit Meets the Web: Team Papelo at FEVER 2024

2024-11-08 · Christopher Malon

Separating disinformation from fact on the web has long challenged both the search and the reasoning powers of humans. We show that the reasoning power of large language models (LLMs) and the retrieval power of modern se…

Question GenerationQuestion-Generation

Team UMBC-FEVER : Claim verification using Semantic Lexical Resources

2018-11-01 · WS 2018 11 · Ankur Padia, Francis Ferraro, Tim Finin

We describe our system used in the 2018 FEVER shared task. The system employed a frame-based information retrieval approach to select Wikipedia sentences providing evidence and used a two-layer multilayer perceptron to c…

Claim VerificationInformation RetrievalRetrieval

Team GPLSI. Approach for automated fact checking

2019-11-01 · WS 2019 11 · Aim{\'e}e Alonso-Reina, Robiert Sep{\'u}lveda-Torres, Estela Saquete, Manuel Palomar

Fever Shared 2.0 Task is a challenge meant for developing automated fact checking systems. Our approach for the Fever 2.0 is based on a previous proposal developed by Team Athene UKP TU Darmstadt. Our proposal modifies t…

ArticlesFact CheckingRetrievalSemantic Similarity+3

Team DOMLIN: Exploiting Evidence Enhancement for the FEVER Shared Task

2019-11-01 · WS 2019 11 · Dominik Stammbach, Guenter Neumann

This paper contains our system description for the second Fact Extraction and VERification (FEVER) challenge. We propose a two-staged sentence selection strategy to account for examples in the dataset where evidence is n…

RetrievalSentence