MT-Clinical BERT: Scaling Clinical Information Extraction with Multitask Learning
Clinical notes contain an abundance of important but not-readily accessible information about patients. Systems to automatically extract this information rely on large amounts of training data for which their exists limited resources to create. Furthermore, they are developed dis-jointly; meaning that no information can be shared amongst task-specific systems. This bottle-neck unnecessarily complicates practical application, reduces the performance capabilities of each individual solution and associates the engineering debt of managing multiple information extraction systems. We address these challenges by developing Multitask-Clinical BERT: a single deep learning model that simultaneously performs eight clinical tasks spanning entity extraction, PHI identification, language entailment and similarity by sharing representations amongst tasks. We find our single system performs competitively with all state-the-art task-specific systems while also benefiting from massive computational benefits at inference.
Code (2)
Tasks
Entity Extraction using GANSimilar Papers 제목 키워드 기반
Clinical Trial Information Extraction with BERT
Natural language processing (NLP) of clinical trial documents can be useful in new trial design. Here we identify entity types relevant to clinical trial design and propose a framework called CT-BERT for information extr…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERClinical Relation Extraction Using Transformer-based Models
The newly emerged transformer technology has a tremendous impact on NLP research. In the general English domain, transformer-based models have achieved state-of-the-art performances on various NLP benchmarks. In the clin…
Binary ClassificationClassificationMulti-class ClassificationRelation+1Distilling Large Language Models for Efficient Clinical Information Extraction
Large language models (LLMs) excel at clinical information extraction but their computational demands limit practical deployment. Knowledge distillation--the process of transferring knowledge from larger to smaller model…
Knowledge Distillationnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+1Incorporating medical knowledge in BERT for clinical relation extraction
In recent years pre-trained language models (PLM) such as BERT have proven to be very effective in diverse NLP tasks such as Information Extraction, Sentiment Analysis and Question Answering. Trained with massive general…
Question AnsweringRelationRelation ExtractionSentiment AnalysisInformation Extraction from Clinical Notes: Are We Ready to Switch to Large Language Models?
Backgrounds: Information extraction (IE) is critical in clinical natural language processing (NLP). While large language models (LLMs) excel on generative tasks, their performance on extractive tasks remains debated. Met…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER+1