paper-with-me

Papers

Two Stage Transformer Model for COVID-19 Fake News Detection and Fact Checking

2020-11-26 · NLP4IF (COLING) 2020 12 · Rutvik Vijjali, Prathyush Potluri, Siddharth Kumar, Sundeep Teki

The rapid advancement of technology in online communication via social media platforms has led to a prolific rise in the spread of misinformation and fake news. Fake news is especially rampant in the current COVID-19 pandemic, leading to people believing in false and potentially harmful claims and stories. Detecting fake news quickly can alleviate the spread of panic, chaos and potential health hazards. We developed a two stage automated pipeline for COVID-19 fake news detection using state of the art machine learning models for natural language processing. The first model leverages a novel fact checking algorithm that retrieves the most relevant facts concerning user claims about particular COVID-19 claims. The second model verifies the level of truth in the claim by computing the textual entailment between the claim and the true facts retrieved from a manually curated COVID-19 dataset. The dataset is based on a publicly available knowledge source consisting of more than 5000 COVID-19 false claims and verified explanations, a subset of which was internally annotated and cross-validated to train and evaluate our models. We evaluate a series of models based on classical text-based features to more contextual Transformer based models and observe that a model pipeline based on BERT and ALBERT for the two stages respectively yields the best results.

📄 PDF Abstract BibTeX arXiv:2011.13253

Code (1)

rutvikvijjali/COVID-19-Claims-Dataset 공식 구현

Tasks

Fact CheckingFake News DetectionMisinformationNatural Language Inference

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Residual Connection 설명 없음
Attention 설명 없음
LAMB LAMB is a a layerwise adaptive large batch optimization technique. It provides a strategy for adapting the learning rate in large batch settings. LAMB uses…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

Transformer based Automatic COVID-19 Fake News Detection System

2021-01-01 · Sunil Gundapu, Radhika Mamidi

Recent rapid technological advancements in online social networks such as Twitter have led to a great incline in spreading false information and fake news. Misinformation is especially prevalent in the ongoing coronaviru…

ArticlesFake News DetectionMisinformation

COVID-19 Fake News Detection Using Bidirectional Encoder Representations from Transformers Based Models

2021-09-30 · Yuxiang Wang, Yongheng Zhang, Xuebo Li, Xinyao Yu

Nowadays, the development of social media allows people to access the latest news easily. During the COVID-19 pandemic, it is important for people to access the news so that they can take corresponding protective measure…

Fake News Detection

Evaluating Deep Learning Approaches for Covid19 Fake News Detection

2021-01-11 · Apurva Wani, Isha Joshi, Snehal Khandve, Vedangi Wagh 외

Social media platforms like Facebook, Twitter, and Instagram have enabled connection and communication on a large scale. It has revolutionized the rate at which information is shared and enhanced its reach. However, anot…

Deep LearningFake News DetectionLanguage Modellingtext-classification+1

Model Generalization on COVID-19 Fake News Detection

2021-01-11 · Yejin Bang, Etsuko Ishii, Samuel Cahyawijaya, Ziwei Ji 외

Amid the pandemic COVID-19, the world is facing unprecedented infodemic with the proliferation of both fake and real information. Considering the problematic consequences that the COVID-19 fake-news have brought, the sci…

Fake News DetectionMisinformationmodel

Exploring Text-transformers in AAAI 2021 Shared Task: COVID-19 Fake News Detection in English

2021-01-07 · Xiangyang Li, Yu Xia, Xiang Long, Zheng Li 외

In this paper, we describe our system for the AAAI 2021 shared task of COVID-19 Fake News Detection in English, where we achieved the 3rd position with the weighted F1 score of 0.9859 on the test set. Specifically, we pr…

Fake News DetectionPosition