A Survey of Spanish Clinical Language Models
This survey focuses in encoder Language Models for solving tasks in the clinical domain in the Spanish language. We review the contributions of 17 corpora focused mainly in clinical tasks, then list the most relevant Spanish Language Models and Spanish Clinical Language models. We perform a thorough comparison of these models by benchmarking them over a curated subset of the available corpora, in order to find the best-performing ones; in total more than 3000 models were fine-tuned for this study. All the tested corpora and the best models are made publically available in an accessible way, so that the results can be reproduced by independent teams or challenged in the future when new Spanish Clinical Language models are created.
Code (0)
등록된 구현이 없습니다.
Tasks
BenchmarkingSurveySimilar Papers 제목 키워드 기반
EriBERTa: A Bilingual Pre-Trained Language Model for Clinical Natural Language Processing
The utilization of clinical reports for various secondary purposes, including health research and treatment monitoring, is crucial for enhancing patient care. Natural Language Processing (NLP) tools have emerged as valua…
Language ModelingLanguage ModellingTransfer LearningPretrained Biomedical Language Models for Clinical NLP in Spanish
This work presents the first large-scale biomedical Spanish language models trained from scratch, using large biomedical corpora consisting of a total of 1.1B tokens and an EHR corpus of 95M tokens. We compared them agai…
NERBiomedical and Clinical Language Models for Spanish: On the Benefits of Domain-Specific Pretraining in a Mid-Resource Scenario
This work presents biomedical and clinical language models for Spanish by experimenting with different pretraining choices, such as masking at word and subword level, varying the vocabulary size and testing with domain d…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERAnnotation of negation in the IULA Spanish Clinical Record Corpus
This paper presents the IULA Spanish Clinical Record Corpus, a corpus of 3,194 sentences extracted from anonymized clinical records and manually annotated with negation markers and their scope. The corpus was conceived a…
Medical DiagnosisNegationNegation DetectionTerm ExtractionClinText-SP and RigoBERTa Clinical: a new set of open resources for Spanish Clinical NLP
We present a novel contribution to Spanish clinical natural language processing by introducing the largest publicly available clinical corpus, ClinText-SP, along with a state-of-the-art clinical encoder language model, R…
Language ModelingLanguage Modelling