paper-with-me

홈 › Papers

Interpretable Self-supervised Multi-task Learning for COVID-19 Information Retrieval and Extraction

2021-06-15 · Nima Ebadi, Peyman Najafirad

The rapidly evolving literature of COVID-19 related articles makes it challenging for NLP models to be effectively trained for information retrieval and extraction with the corresponding labeled data that follows the current distribution of the pandemic. On the other hand, due to the uncertainty of the situation, human experts' supervision would always be required to double check the decision making of these models highlighting the importance of interpretability. In the light of these challenges, this study proposes an interpretable self-supervised multi-task learning model to jointly and effectively tackle the tasks of information retrieval (IR) and extraction (IE) during the current emergency health crisis situation. Our results show that our model effectively leverage the multi-task and self-supervised learning to improve generalization, data efficiency and robustness to the ongoing dataset shift problem. Our model outperforms baselines in IE and IR tasks, respectively by micro-f score of 0.08 (LCA-F score of 0.05), and MAP of 0.05 on average. In IE the zero- and few-shot learning performances are on average 0.32 and 0.19 micro-f score higher than those of the baselines.

📄 PDF Abstract BibTeX arXiv:2106.08252

Code (0)

등록된 구현이 없습니다.

Tasks

ArticlesDecision MakingFew-Shot LearningInformation RetrievalMulti-Task LearningRetrievalSelf-Supervised Learning

Similar Papers 제목 키워드 기반

Self-Knowledge Distillation based Self-Supervised Learning for Covid-19 Detection from Chest X-Ray Images

2022-06-07 · Guang Li, Ren Togo, Takahiro Ogawa, Miki Haseyama

The global outbreak of the Coronavirus 2019 (COVID-19) has overloaded worldwide healthcare systems. Computer-aided diagnosis for COVID-19 fast detection and patient triage is becoming critical. This paper proposes a nove…

Knowledge DistillationSelf-Knowledge DistillationSelf-Supervised Learning

Learning from Pseudo Lesion: A Self-supervised Framework for COVID-19 Diagnosis

2021-06-23 · Zhongliang Li, Zhihao Jin, Xuechen Li, Linlin Shen

The Coronavirus disease 2019 (COVID-19) has rapidly spread all over the world since its first report in December 2019 and thoracic computed tomography (CT) has become one of the main tools for its diagnosis. In recent ye…

Computed Tomography (CT)COVID-19 DiagnosisDecoderImage Restoration+1

Multi-Feature Vision Transformer via Self-Supervised Representation Learning for Improvement of COVID-19 Diagnosis

2022-08-03 · Xiao Qi, David J. Foran, John L. Nosher, Ilker Hacihaliloglu

The role of chest X-ray (CXR) imaging, due to being more cost-effective, widely available, and having a faster acquisition time compared to CT, has evolved during the COVID-19 pandemic. To improve the diagnostic performa…

COVID-19 DiagnosisDiagnosticRepresentation LearningSelf-Supervised Learning

Self-Supervision and Multi-Task Learning: Challenges in Fine-Grained COVID-19 Multi-Class Classification from Chest X-rays

2022-01-16 · Muhammad Ridzuan, Ameera Ali Bawazir, Ivo Gollini Navarette, Ibrahim Almakky 외

Quick and accurate diagnosis is of paramount importance to mitigate the effects of COVID-19 infection, particularly for severe cases. Enormous effort has been put towards developing deep learning methods to classify and …

ClassificationMulti-class ClassificationMulti-Task Learning

Boosting Automatic COVID-19 Detection Performance with Self-Supervised Learning and Batch Knowledge Ensembling

2022-12-19 · Guang Li, Ren Togo, Takahiro Ogawa, Miki Haseyama

Problem: Detecting COVID-19 from chest X-Ray (CXR) images has become one of the fastest and easiest methods for detecting COVID-19. However, the existing methods usually use supervised transfer learning from natural imag…

Self-Supervised LearningTransfer Learning