Sensitive Data Detection and Classification in Spanish Clinical Text: Experiments with BERT
Massive digital data processing provides a wide range of opportunities and benefits, but at the cost of endangering personal data privacy. Anonymisation consists in removing or replacing sensitive information from data, enabling its exploitation for different purposes while preserving the privacy of individuals. Over the years, a lot of automatic anonymisation systems have been proposed; however, depending on the type of data, the target language or the availability of training documents, the task remains challenging still. The emergence of novel deep-learning models during the last two years has brought large improvements to the state of the art in the field of Natural Language Processing. These advancements have been most noticeably led by BERT, a model proposed by Google in 2018, and the shared language models pre-trained on millions of documents. In this paper, we use a BERT-based sequence labelling model to conduct a series of anonymisation experiments on several clinical datasets in Spanish. We also compare BERT to other algorithms. The experiments show that a simple BERT-based model with general-domain pre-training obtains highly competitive results without any domain specific feature engineering.
Code (0)
등록된 구현이 없습니다.
Tasks
Feature EngineeringGeneral ClassificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
HitzalMed: Anonymisation of Clinical Text in Spanish
HitzalMed is a web-framed tool that performs automatic detection of sensitive information in clinical texts using machine learning algorithms reported to be competitive for the task. Moreover, once sensitive information …
BIG-bench Machine LearningTransfer learning applied to text classification in Spanish radiological reports
Pre-trained text encoders have rapidly advanced the state-of-the-art on many Natural Language Processing tasks. This paper presents the use of transfer learning methods applied to the automatic detection of codes in radi…
ClassificationGeneral Classificationtext-classificationText Classification+1Common Ground, Diverse Roots: The Difficulty of Classifying Common Examples in Spanish Varieties
Variations in languages across geographic regions or cultures are crucial to address to avoid biases in NLP systems designed for culturally sensitive tasks, such as hate speech detection or dialog with conversational age…
FairnessHate Speech DetectionvalidExploring Large Language Models for Hate Speech Detection in Rioplatense Spanish
Hate speech detection deals with many language variants, slang, slurs, expression modalities, and cultural nuances. This outlines the importance of working with specific corpora, when addressing hate speech within the sc…
Hate Speech DetectionFine-Tuned Large Language Models for Symptom Recognition from Spanish Clinical Text
The accurate recognition of symptoms in clinical reports is significantly important in the fields of healthcare and biomedical natural language processing. These entities serve as essential building blocks for clinical i…
Retrieval