paper-with-me

Papers

Automated Spinal MRI Labelling from Reports Using a Large Language Model

2024-10-22 · Robin Y. Park, Rhydian Windsor, Amir Jamaludin, Andrew Zisserman

We propose a general pipeline to automate the extraction of labels from radiology reports using large language models, which we validate on spinal MRI reports. The efficacy of our labelling method is measured on five distinct conditions: spinal cancer, stenosis, spondylolisthesis, cauda equina compression and herniation. Using open-source models, our method equals or surpasses GPT-4 on a held-out set of reports. Furthermore, we show that the extracted labels can be used to train imaging models to classify the identified conditions in the accompanying MR scans. All classifiers trained using automated labels achieve comparable performance to models trained using scans manually annotated by clinicians. Code can be found at https://github.com/robinyjpark/AutoLabelClassifier.

📄 PDF Abstract BibTeX arXiv:2410.17235

Code (1)

robinyjpark/autolabelclassifier 공식 구현 pytorch

Tasks

Language ModelingLanguage ModellingLarge Language Model

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Multi-Head Attention 설명 없음
Adam 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Similar Papers 제목 키워드 기반

DeepSPINE: Automated Lumbar Vertebral Segmentation, Disc-level Designation, and Spinal Stenosis Grading Using Deep Learning

2018-07-26 · Jen-Tang Lu, Stefano Pedemonte, Bernardo Bizzo, Sean Doyle 외

The high prevalence of spinal stenosis results in a large volume of MRI imaging, yet interpretation can be time-consuming with high inter-reader variability even among the most specialized radiologists. In this paper, we…

Automated Labelling using an Attention model for Radiology reports of MRI scans (ALARM)

2020-02-16 · MIDL 2019 7 · David A. Wood, Jeremy Lynch, Sina Kafiabadi, Emily Guilhem 외

Labelling large datasets for training high-capacity neural networks is a major obstacle to the development of deep learning-based medical imaging applications. Here we present a transformer-based network for magnetic res…

Labelling imaging datasets on the basis of neuroradiology reports: a validation study

2020-07-08 · David A. Wood, Sina Kafiabadi, Aisha Al Busaidi, Emily Guilhem 외

Natural language processing (NLP) shows promise as a means to automate the labelling of hospital-scale neuroradiology magnetic resonance imaging (MRI) datasets for computer vision applications. To date, however, there ha…

SpineNetV2: Automated Detection, Labelling and Radiological Grading Of Clinical MR Scans

2022-05-03 · Rhydian Windsor, Amir Jamaludin, Timor Kadir, Andrew Zisserman

This technical report presents SpineNetV2, an automated tool which: (i) detects and labels vertebral bodies in clinical spinal magnetic resonance (MR) scans across a range of commonly used sequences; and (ii) performs ra…

Body Detection

Unifying Neural Learning and Symbolic Reasoning for Spinal Medical Report Generation

2020-04-28 · Zhongyi Han, Benzheng Wei, Yilong Yin, Shuo Li

Automated medical report generation in spine radiology, i.e., given spinal medical images and directly create radiologist-level diagnosis reports to support clinical decision making, is a novel yet fundamental study in t…

Decision MakingGenerative Adversarial NetworkLogical ReasoningMedical Report Generation+1