A BERT-based One-Pass Multi-Task Model for Clinical Temporal Relation Extraction
Recently BERT has achieved a state-of-the-art performance in temporal relation extraction from clinical Electronic Medical Records text. However, the current approach is inefficient as it requires multiple passes through each input sequence. We extend a recently-proposed one-pass model for relation classification to a one-pass model for relation extraction. We augment this framework by introducing global embeddings to help with long-distance relation inference, and by multi-task learning to increase model performance and generalizability. Our proposed model produces results on par with the state-of-the-art in temporal relation extraction on the THYME corpus and is much {``}greener{''} in computational cost.
Code (0)
등록된 구현이 없습니다.
Tasks
Multi-Task LearningRelationRelation ClassificationRelation ExtractionTemporal Relation ExtractionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
CEHR-BERT: Incorporating temporal information from structured EHR data to improve prediction tasks
Embedding algorithms are increasingly used to represent clinical concepts in healthcare for improving machine learning tasks such as clinical phenotyping and disease prediction. Recent studies have adapted state-of-the-a…
Disease PredictionTransfer LearningA BERT-based Universal Model for Both Within- and Cross-sentence Clinical Temporal Relation Extraction
Classic methods for clinical temporal relation extraction focus on relational candidates within a sentence. On the other hand, break-through Bidirectional Encoder Representations from Transformers (BERT) are trained on l…
RelationRelation ExtractionSentenceTemporal Relation ExtractionImproving Representation Learning of Complex Critical Care Data with ICU-BERT
The multivariate, asynchronous nature of real-world clinical data, such as that generated in Intensive Care Units (ICUs), challenges traditional AI-based decision-support systems. These often assume data regularity and f…
Feature EngineeringLanguage ModelingLanguage ModellingLarge Language Model+1KliniskVestBERT: BERT Model Specialised to Norwegian Clinical Texts
The increasing application of Natural Language Processing (NLP) in healthcare demands language models specifically attuned to the complexities of clinical language. This work introduces KliniskVestBERT, a suite of three …
Robustly Pre-trained Neural Model for Direct Temporal Relation Extraction
Background: Identifying relationships between clinical events and temporal expressions is a key challenge in meaningfully analyzing clinical text for use in advanced AI applications. While previous studies exist, the sta…
Language ModelingLanguage ModellingRelationRelation Extraction+1