Selective Fine-tuning on LLM-labeled Data May Reduce Reliance on Human Annotation: A Case Study Using Schedule-of-Event Table Detection

2024-05-09 · Bhawesh Kumar, Jonathan Amar, Eric Yang, Nan Li, Yugang Jia

Large Language Models (LLMs) have demonstrated their efficacy across a broad spectrum of tasks in healthcare applications. However, often LLMs need to be fine-tuned on task-specific expert annotated data to achieve optimal performance, which can be expensive and time consuming. In this study, we fine-tune PaLM-2 with parameter efficient fine-tuning (PEFT) using noisy labels obtained from gemini-pro 1.0 for the detection of Schedule-of-Event (SoE) tables, which specify care plan in clinical trial protocols. We introduce a filtering mechanism to select high-confidence labels for this table classification task, thereby reducing the noise in the auto-generated labels. We show that fine-tuned PaLM-2 with those labels achieves performance that exceeds the gemini-pro 1.0 and other LLMs. Furthermore, its performance is close to a PaLM-2 fine-tuned on labels obtained from non-expert annotators. Our results show that leveraging LLM-generated labels through powerful models like gemini-pro can potentially serve as a viable strategy for improving LLM performance through fine-tuning in specialized tasks, particularly in domains where expert annotations are scarce, expensive, or time-consuming to obtain.

📄 PDF Abstract BibTeX arXiv:2405.06093

Code (0)

등록된 구현이 없습니다.

Tasks

parameter-efficient fine-tuning Table Detection

Adapting Medical Vision Foundation Models for Volumetric Medical Image Segmentation via Active Learning and Selective Semi-supervised Fine-tuning

2025-09-13 · Jin Yang, Daniel S. Marcus, Aristeidis Sotiras arxiv

Medical vision foundation models remain limited in downstream tasks, particularly volumetric medical image segmentation. While fine-tuning on labeled target-domain data improves performance, existing approaches typically…

Volumetric Medical Image Segmentation Active Learning

Selective Fine-Tuning of GPT Architectures for Parameter-Efficient Clinical Text Classification

2026-03-15 · Fariba Afrin Irany, Sampson Akwafuo arxiv

The rapid expansion of electronic health record (EHR) systems has generated large volumes of unstructured clinical narratives that contain valuable information for disease identification, patient cohort discovery, and cl…

Computational Efficiency Text Classification

SLPT: Selective Labeling Meets Prompt Tuning on Label-Limited Lesion Segmentation

2023-08-09 · Fan Bai, Ke Yan, Xiaoyu Bai, Xinyu Mao 외

Medical image analysis using deep learning is often challenged by limited labeled data and high annotation costs. Fine-tuning the entire network in label-limited scenarios can lead to overfitting and suboptimal performan…

Lesion Segmentation Medical Image Analysis Tumor Segmentation Visual Prompt Tuning

SafeMERGE: Preserving Safety Alignment in Fine-Tuned Large Language Models via Selective Layer-Wise Model Merging

2025-03-21 · Aladin Djuhera, Swanand Ravindra Kadhe, Farhan Ahmed, Syed Zawad 외

Fine-tuning large language models (LLMs) on downstream tasks can inadvertently erode their safety alignment, even for benign fine-tuning datasets. We address this challenge by proposing SafeMERGE, a post-fine-tuning fram…

GSM8K Safety Alignment

Fine Tuning without Catastrophic Forgetting via Selective Low Rank Adaptation

2025-01-26 · Reza Akbarian Bafghi, Carden Bagwell, Avinash Ravichandran, Ashish Shrivastava 외

Adapting deep learning models to new domains often requires computationally intensive retraining and risks catastrophic forgetting. While fine-tuning enables domain-specific adaptation, it can reduce robustness to distri…

parameter-efficient fine-tuning