paper-with-me

Papers

Sensitive Data Detection and Classification in Spanish Clinical Text: Experiments with BERT

2020-03-06 · LREC 2020 5 · Aitor García-Pablos, Naiara Perez, Montse Cuadros

Massive digital data processing provides a wide range of opportunities and benefits, but at the cost of endangering personal data privacy. Anonymisation consists in removing or replacing sensitive information from data, enabling its exploitation for different purposes while preserving the privacy of individuals. Over the years, a lot of automatic anonymisation systems have been proposed; however, depending on the type of data, the target language or the availability of training documents, the task remains challenging still. The emergence of novel deep-learning models during the last two years has brought large improvements to the state of the art in the field of Natural Language Processing. These advancements have been most noticeably led by BERT, a model proposed by Google in 2018, and the shared language models pre-trained on millions of documents. In this paper, we use a BERT-based sequence labelling model to conduct a series of anonymisation experiments on several clinical datasets in Spanish. We also compare BERT to other algorithms. The experiments show that a simple BERT-based model with general-domain pre-training obtains highly competitive results without any domain specific feature engineering.

📄 PDF Abstract BibTeX arXiv:2003.03106

Code (0)

등록된 구현이 없습니다.

Tasks

Feature EngineeringGeneral Classification

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Residual Connection 설명 없음
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Weight Decay 설명 없음
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Adam 설명 없음

Similar Papers 제목 키워드 기반

HitzalMed: Anonymisation of Clinical Text in Spanish

2020-05-01 · LREC 2020 5 · Salvador Lima Lopez, Naiara Perez, Laura Garc{\'\i}a-Sardi{\~n}a, Montse Cuadros

HitzalMed is a web-framed tool that performs automatic detection of sensitive information in clinical texts using machine learning algorithms reported to be competitive for the task. Moreover, once sensitive information …

BIG-bench Machine Learning

Transfer learning applied to text classification in Spanish radiological reports

2020-05-01 · LREC 2020 5 · Pilar L{\'o}pez {\'U}beda, Manuel Carlos D{\'\i}az-Galiano, L. Alfonso Urena Lopez, Maite Martin 외

Pre-trained text encoders have rapidly advanced the state-of-the-art on many Natural Language Processing tasks. This paper presents the use of transfer learning methods applied to the automatic detection of codes in radi…

ClassificationGeneral Classificationtext-classificationText Classification+1

Common Ground, Diverse Roots: The Difficulty of Classifying Common Examples in Spanish Varieties

2024-12-16 · Javier A. Lopetegui, Arij Riabi, Djamé Seddah

Variations in languages across geographic regions or cultures are crucial to address to avoid biases in NLP systems designed for culturally sensitive tasks, such as hate speech detection or dialog with conversational age…

FairnessHate Speech Detectionvalid

Exploring Large Language Models for Hate Speech Detection in Rioplatense Spanish

2024-10-16 · Juan Manuel Pérez, Paula Miguel, Viviana Cotik

Hate speech detection deals with many language variants, slang, slurs, expression modalities, and cultural nuances. This outlines the importance of working with specific corpora, when addressing hate speech within the sc…

Hate Speech Detection

Fine-Tuned Large Language Models for Symptom Recognition from Spanish Clinical Text

2024-01-28 · Mai A. Shaaban, Abbas Akkasi, Adnan Khan, Majid Komeili 외

The accurate recognition of symptoms in clinical reports is significantly important in the fields of healthcare and biomedical natural language processing. These entities serve as essential building blocks for clinical i…

Retrieval