paper-with-me

Papers

Clinical Trial Information Extraction with BERT

2021-09-11 · Xiong Liu, Greg L. Hersch, Iya Khalil, Murthy Devarakonda

Natural language processing (NLP) of clinical trial documents can be useful in new trial design. Here we identify entity types relevant to clinical trial design and propose a framework called CT-BERT for information extraction from clinical trial text. We trained named entity recognition (NER) models to extract eligibility criteria entities by fine-tuning a set of pre-trained BERT models. We then compared the performance of CT-BERT with recent baseline methods including attention-based BiLSTM and Criteria2Query. The results demonstrate the superiority of CT-BERT in clinical trial NLP.

📄 PDF Abstract BibTeX arXiv:2110.10027

Code (0)

등록된 구현이 없습니다.

Tasks

named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Tanh Activation 설명 없음
Sigmoid Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…
Weight Decay 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

An Interpretable End-to-end Fine-tuning Approach for Long Clinical Text

2020-11-12 · Kexin Huang, Sankeerth Garapati, Alexander S. Rich

Unstructured clinical text in EHRs contains crucial information for applications including decision support, trial matching, and retrospective research. Recent work has applied BERT-based models to clinical information e…

text-classificationText Classification

A novel language model for predicting serious adverse event results in clinical trials from their prospective registrations

2025-07-21 · Qixuan Hu, Xumou Zhang, Jinman Kim, Florence Bourgeois 외 arxiv

Objectives: With accurate estimates of expected safety results, clinical trials could be better designed and monitored. We evaluated methods for predicting serious adverse event (SAE) results in clinical trials using inf…

Transfer Learning

Joint Learning with Pre-trained Transformer on Named Entity Recognition and Relation Extraction Tasks for Clinical Analytics

2020-11-01 · EMNLP (ClinicalNLP) 2020 11 · Miao Chen, Ganhui Lan, Fang Du, Victor Lobanov

In drug development, protocols define how clinical trials are conducted, and are therefore of paramount importance. They contain key patient-, investigator-, medication-, and study-related information, often elaborated i…

named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER+1

AI-assisted Protocol Information Extraction For Improved Accuracy and Efficiency in Clinical Trial Workflows

2026-01-19 · Ramtin Babaeipour, François Charest, Madison Wright arxiv

Increasing clinical trial protocol complexity, amendments, and challenges around knowledge management create significant burden for trial teams. Structuring protocol content into standard formats has the potential to imp…

Information Extraction

Distilling Large Language Models for Efficient Clinical Information Extraction

2024-12-21 · Karthik S. Vedula, Annika Gupta, Akshay Swaminathan, Ivan Lopez 외

Large language models (LLMs) excel at clinical information extraction but their computational demands limit practical deployment. Knowledge distillation--the process of transferring knowledge from larger to smaller model…

Knowledge Distillationnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+1