paper-with-me

홈 › Papers

Document Classification for COVID-19 Literature

2020-06-15 · NLP-COVID19 (ACL) 2020 7 · Bernal Jiménez Gutiérrez, Juncheng Zeng, Dong-dong Zhang, Ping Zhang, Yu Su

The global pandemic has made it more important than ever to quickly and accurately retrieve relevant scientific literature for effective consumption by researchers in a wide range of fields. We provide an analysis of several multi-label document classification models on the LitCovid dataset, a growing collection of 23,000 research papers regarding the novel 2019 coronavirus. We find that pre-trained language models fine-tuned on this dataset outperform all other baselines and that BioBERT surpasses the others by a small margin with micro-F1 and accuracy scores of around 86% and 75% respectively on the test set. We evaluate the data efficiency and generalizability of these models as essential features of any system prepared to deal with an urgent situation like the current health crisis. Finally, we explore 50 errors made by the best performing models on LitCovid documents and find that they often (1) correlate certain labels too closely together and (2) fail to focus on discriminative sections of the articles; both of which are important issues to address in future work. Both data and code are available on GitHub.

📄 PDF Abstract BibTeX arXiv:2006.13816

Code (1)

dki-lab/covid19-classification 공식 구현 pytorch

Tasks

ArticlesClassificationDocument ClassificationGeneral Classification

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
AdamW AdamW is a stochastic optimization method that modifies the typical implementation of weight decay in Adam, by decoupling [weight…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Attention 설명 없음
How do I get a human at Expedia immediately? (2025-2026) How do I get a human at Expedia immediately? (2025 Complete Guide) Most travelers run into a point where self-service isn’t enough, and speaking to a real person becomes the…

Similar Papers 제목 키워드 기반

Classification of COVID19 tweets using Machine Learning Approaches

2021-06-01 · NAACL (SMM4H) 2021 6 · Anupam Mondal, Sainik Mahata, Monalisa Dey, Dipankar Das

The reported work is a description of our participation in the “Classification of COVID19 tweets containing symptoms” shared task, organized by the “Social Media Mining for Health Applications (SMM4H)” workshop. The lite…

BIG-bench Machine LearningClassification

Navigating the landscape of COVID-19 research through literature analysis: A bird's eye view

2020-08-07 · Lana Yeganova, Rezarta Islamaj, Qingyu Chen, Robert Leaman 외

Timely access to accurate scientific literature in the battle with the ongoing COVID-19 pandemic is critical. This unprecedented public health risk has motivated research towards understanding the disease in general, ide…

ArticlesClusteringnamed-entity-recognitionNamed Entity Recognition+2

COV19IR : COVID-19 Domain Literature Information Retrieval

2022-11-08 · Arusarka Bose, Zili Zhou, Guandong Xu

Increasing number of COVID-19 research literatures cause new challenges in effective literature screening and COVID-19 domain knowledge aware Information Retrieval. To tackle the challenges, we demonstrate two tasks alon…

Information RetrievalQuestion AnsweringRetrieval

S_Covid: An Engine to Explore COVID-19 Scientific Literature

2020-10-21 · Mehrdad Farokhnejad, Raj Ratn Pranesh, Genoveva Vargas-Solar, Davoud Amiri Mehr

This paper introduces S_Covid, an end-to-end unsupervised learning based question-answering engine for exploring COVID-19 scientific literature collections. S_Covid enables documents exploration for finding relevant rese…

Information RetrievalQuestion AnsweringRetrieval

Prioritization of COVID-19-related literature via unsupervised keyphrase extraction and document representation learning

2021-10-17 · Blaž Škrlj, Marko Jukič, Nika Eržen, Senja Pollak 외

The COVID-19 pandemic triggered a wave of novel scientific literature that is impossible to inspect and study in a reasonable time frame manually. Current machine learning methods offer to project such body of literature…

Keyphrase ExtractionRepresentation Learning