paper-with-me

홈 › Papers

DeID-GPT: Zero-shot Medical Text De-Identification by GPT-4

2023-03-20 · Zhengliang Liu, Yue Huang, Xiaowei Yu, Lu Zhang, Zihao Wu, Chao Cao, Haixing Dai, Lin Zhao, Yiwei Li, Peng Shu, Fang Zeng, Lichao Sun, Wei Liu, Dinggang Shen, Quanzheng Li, Tianming Liu, Dajiang Zhu, Xiang Li

The digitization of healthcare has facilitated the sharing and re-using of medical data but has also raised concerns about confidentiality and privacy. HIPAA (Health Insurance Portability and Accountability Act) mandates removing re-identifying information before the dissemination of medical records. Thus, effective and efficient solutions for de-identifying medical data, especially those in free-text forms, are highly needed. While various computer-assisted de-identification methods, including both rule-based and learning-based, have been developed and used in prior practice, such solutions still lack generalizability or need to be fine-tuned according to different scenarios, significantly imposing restrictions in wider use. The advancement of large language models (LLM), such as ChatGPT and GPT-4, have shown great potential in processing text data in the medical domain with zero-shot in-context learning, especially in the task of privacy protection, as these models can identify confidential information by their powerful named entity recognition (NER) capability. In this work, we developed a novel GPT4-enabled de-identification framework (``DeID-GPT") to automatically identify and remove the identifying information. Compared to existing commonly used medical text data de-identification methods, our developed DeID-GPT showed the highest accuracy and remarkable reliability in masking private information from the unstructured medical text while preserving the original structure and meaning of the text. This study is one of the earliest to utilize ChatGPT and GPT-4 for medical text data processing and de-identification, which provides insights for further research and solution development on the use of LLMs such as ChatGPT/GPT-4 in healthcare. Codes and benchmarking data information are available at https://github.com/yhydhx/ChatGPT-API.

📄 PDF Abstract BibTeX arXiv:2303.11032

Code (1)

yhydhx/chatgpt-api 공식 구현

Tasks

BenchmarkingDe-identificationIn-Context Learningnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

DeID-VC: Speaker De-identification via Zero-shot Pseudo Voice Conversion

2022-09-09 · Ruibin Yuan, Yuxuan Wu, Jacob Li, Jaxter Kim

The widespread adoption of speech-based online services raises security and privacy concerns regarding the data that they use and share. If the data were compromised, attackers could exploit user speech to bypass speaker…

De-identificationSpeaker VerificationVoice Conversion

Can Zero-Shot Commercial APIs Deliver Regulatory-Grade Clinical Text DeIdentification?

2025-03-21 · Veysel Kocaman, Muhammed Santas, Yigit Gul, Mehmet Butgul 외

We evaluate the performance of four leading solutions for de-identification of unstructured medical text - Azure Health Data Services, AWS Comprehend Medical, OpenAI GPT-4o, and John Snow Labs - on a ground truth dataset…

De-identification

DIRI: Adversarial Patient Reidentification with Large Language Models for Evaluating Clinical Text Anonymization

2024-10-22 · John X. Morris, Thomas R. Campion, Sri Laasya Nutheti, Yifan Peng 외

Sharing protected health information (PHI) is critical for furthering biomedical research. Before data can be distributed, practitioners often perform deidentification to remove any PHI contained in the text. Contemporar…

De-identificationLanguage ModelingLanguage ModellingLarge Language Model+1

Medical Manifestation-Aware De-Identification

2024-12-14 · Yuan Tian, Shuo Wang, Guangtao Zhai

Face de-identification (DeID) has been widely studied for common scenes, but remains under-researched for medical scenes, mostly due to the lack of large-scale patient face datasets. In this paper, we release MeMa, consi…

De-identification

Pyclipse, a library for deidentification of free-text clinical notes

2023-11-05 · Callandra Moore, Jonathan Ranisau, Walter Nelson, Jeremy Petch 외

Automated deidentification of clinical text data is crucial due to the high cost of manual deidentification, which has been a barrier to sharing clinical text and the advancement of clinical natural language processing. …