Ensemble-based Fine-Tuning Strategy for Temporal Relation Extraction from the Clinical Narrative
In this paper, we investigate ensemble methods for fine-tuning transformer-based pretrained models for clinical natural language processing tasks, specifically temporal relation extraction from the clinical narrative. Our experimental results on the THYME data show that ensembling as a fine-tuning strategy can further boost model performance over single learners optimized for hyperparameters. Dynamic snapshot ensembling is particularly beneficial as it fine-tunes a wide array of parameters and results in a 2.8% absolute improvement in F1 over the base single learner.
Code (0)
등록된 구현이 없습니다.
Tasks
RelationRelation ExtractionTemporal Relation ExtractionSimilar Papers 제목 키워드 기반
A Graph Prompt Fine-Tuning Method for WSN Spatio-Temporal Correlation Anomaly Detection
Anomaly detection of multi-temporal modal data in Wireless Sensor Network (WSN) can provide an important guarantee for reliable network operation. Existing anomaly detection methods in multi-temporal modal data scenarios…
Self-Supervised LearningGraph Neural NetworkAnomaly DetectionEnsemble Making Few-Shot Learning Stronger
Few-shot learning has been proposed and rapidly emerging as a viable means for completing various tasks. Many few-shot models have been widely used for relation learning tasks. However, each of these models has a shortag…
Few-Shot LearningRelationRelation ExtractionCLIPood: Generalizing CLIP to Out-of-Distributions
Out-of-distribution (OOD) generalization, where the model needs to handle distribution shifts from training, is a major challenge of machine learning. Contrastive language-image pre-training (CLIP) models have shown impr…
Ensemble Monitoring for AI Control: Diverse Signals Outweigh More Compute
As AI systems are increasingly deployed in autonomous agentic settings at scale, it is important to ensure the actions they take are safe and aligned with user intent. Monitoring agent actions is a key safety mechanism, …
Action Recognition Using Temporal Shift Module and Ensemble Learning
This paper presents the first-rank solution for the Multi-Modal Action Recognition Challenge, part of the Multi-Modal Visual Pattern Recognition Workshop at the \acl{ICPR} 2024. The competition aimed to recognize human a…
Action RecognitionComputational EfficiencyEnsemble LearningTransfer Learning