Fine-Tuning LLMs on Small Medical Datasets: Text Classification and Normalization Effectiveness on Cardiology reports and Discharge records

2025-03-27 · Noah Losch, Lucas Plagwitz, Antonius Büscher, Julian Varghese

We investigate the effectiveness of fine-tuning large language models (LLMs) on small medical datasets for text classification and named entity recognition tasks. Using a German cardiology report dataset and the i2b2 Smoking Challenge dataset, we demonstrate that fine-tuning small LLMs locally on limited training data can improve performance achieving comparable results to larger models. Our experiments show that fine-tuning improves performance on both tasks, with notable gains observed with as few as 200-300 training examples. Overall, the study highlights the potential of task-specific fine-tuning of LLMs for automating clinical workflows and efficiently extracting structured data from unstructured medical text.

📄 PDF Abstract BibTeX arXiv:2503.21349

Code (0)

등록된 구현이 없습니다.

Tasks

named-entity-recognitionNamed Entity Recognitiontext-classification Text Classification

Taiyi: A Bilingual Fine-Tuned Large Language Model for Diverse Biomedical Tasks

2023-11-20 · Ling Luo, Jinzhong Ning, Yingwen Zhao, Zhijun Wang 외

Objective: Most existing fine-tuned biomedical large language models (LLMs) focus on enhancing performance in monolingual biomedical question answering and conversation tasks. To investigate the effectiveness of the fine…

Language Modeling Language Modelling Large Language Model named-entity-recognition+5

Small LLMs for Medical NLP: a Systematic Analysis of Few-Shot, Constraint Decoding, Fine-Tuning and Continual Pre-Training in Italian

2026-02-19 · Pietro Ferrazzi, Mattia Franzin, Alberto Lavelli, Bernardo Magnini arxiv

Large Language Models (LLMs) consistently excel in diverse medical Natural Language Processing (NLP) tasks, yet their substantial computational requirements often limit deployment in real-world healthcare settings. In th…

Continual Pretraining Relation Extraction Question Answering Argument Mining

Med42 -- Evaluating Fine-Tuning Strategies for Medical LLMs: Full-Parameter vs. Parameter-Efficient Approaches

2024-04-23 · Clément Christophe, Praveen K Kanithi, Prateek Munjal, Tathagata Raha 외

This study presents a comprehensive analysis and comparison of two predominant fine-tuning methodologies - full-parameter fine-tuning and parameter-efficient tuning - within the context of medical Large Language Models (…

Question Answering Retrieval

When MOE Meets LLMs: Parameter Efficient Fine-tuning for Multi-task Medical Applications

2023-10-21 · Qidong Liu, Xian Wu, Xiangyu Zhao, Yuanshao Zhu 외

The recent surge in Large Language Models (LLMs) has garnered significant attention across numerous fields. Fine-tuning is often required to fit general LLMs for a specific domain, like the web-based healthcare system. H…

Multi-Task Learning parameter-efficient fine-tuning

BioTool: A Comprehensive Tool-Calling Dataset for Enhancing Biomedical Capabilities of Large Language Models

2026-05-07 · Xin Gao, Ruiyi Zhang, Meixi Du, Peijia Qin 외 arxiv

Despite the success of large language models (LLMs) on general-purpose tasks, their performance in highly specialized domains such as biomedicine remains unsatisfactory. A key limitation is the inability of LLMs to effec…