Self-supervised context-aware COVID-19 document exploration through atlas grounding
In this paper, we aim to develop a self-supervised grounding of Covid-related medical text based on the actual spatial relationships between the referred anatomical concepts. More specifically, we learn to project sentences into a physical space defined by a three-dimensional anatomical atlas, allowing for a visual approach to navigating Covid-related literature. We design a straightforward and empirically effective training objective to reduce the curated data dependency issue. We use BERT as the main building block of our model and perform a quantitative analysis that demonstrates that the model learns a context-aware mapping. We illustrate two potential use-cases for our approach, one in interactive, 3D data exploration, and the other in document retrieval. To accelerate research in this direction, we make public all trained models, codebase and the developed tools, which can be accessed at https://github.com/gorjanradevski/macchina/.
Code (1)
Tasks
RetrievalMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Self-Supervised Representation Learning on Document Images
This work analyses the impact of self-supervised pre-training on document images in the context of document image classification. While previous approaches explore the effect of self-supervision on natural images, we sho…
Classificationdocument-image-classificationDocument Image ClassificationGeneral Classification+3Context-aware Self-supervised Learning for Medical Images Using Graph Neural Network
Although self-supervised learning enables us to bootstrap the training by exploiting unlabeled data, the generic self-supervised methods for natural images do not sufficiently incorporate the context. For medical images,…
AnatomyGraph Neural NetworkRepresentation LearningSelf-Supervised LearningContext Matters: Graph-based Self-supervised Representation Learning for Medical Images
Supervised learning method requires a large volume of annotated datasets. Collecting such datasets is time-consuming and expensive. Until now, very few annotated COVID-19 imaging datasets are available. Although self-sup…
AnatomyRepresentation LearningSelf-Supervised LearningMulti-Feature Vision Transformer via Self-Supervised Representation Learning for Improvement of COVID-19 Diagnosis
The role of chest X-ray (CXR) imaging, due to being more cost-effective, widely available, and having a faster acquisition time compared to CT, has evolved during the COVID-19 pandemic. To improve the diagnostic performa…
COVID-19 DiagnosisDiagnosticRepresentation LearningSelf-Supervised LearningCAST: Corpus-Aware Self-similarity Enhanced Topic modelling
Topic modelling is a pivotal unsupervised machine learning technique for extracting valuable insights from large document collections. Existing neural topic modelling methods often encode contextual information of docume…
Contrastive LearningDiversityWord Embeddings