paper-with-me

홈 › Papers

Leveraging Task-Specific Knowledge from LLM for Semi-Supervised 3D Medical Image Segmentation

2024-07-06 · Suruchi Kumari, Aryan Das, Swalpa Kumar Roy, Indu Joshi, Pravendra Singh

Traditional supervised 3D medical image segmentation models need voxel-level annotations, which require huge human effort, time, and cost. Semi-supervised learning (SSL) addresses this limitation of supervised learning by facilitating learning with a limited annotated and larger amount of unannotated training samples. However, state-of-the-art SSL models still struggle to fully exploit the potential of learning from unannotated samples. To facilitate effective learning from unannotated data, we introduce LLM-SegNet, which exploits a large language model (LLM) to integrate task-specific knowledge into our co-training framework. This knowledge aids the model in comprehensively understanding the features of the region of interest (ROI), ultimately leading to more efficient segmentation. Additionally, to further reduce erroneous segmentation, we propose a Unified Segmentation loss function. This loss function reduces erroneous segmentation by not only prioritizing regions where the model is confident in predicting between foreground or background pixels but also effectively addressing areas where the model lacks high confidence in predictions. Experiments on publicly available Left Atrium, Pancreas-CT, and Brats-19 datasets demonstrate the superior performance of LLM-SegNet compared to the state-of-the-art. Furthermore, we conducted several ablation studies to demonstrate the effectiveness of various modules and loss functions leveraged by LLM-SegNet.

📄 PDF Abstract BibTeX arXiv:2407.05088

Code (0)

등록된 구현이 없습니다.

Tasks

Image SegmentationLanguage ModellingLarge Language ModelMedical Image SegmentationSegmentationSemantic Segmentation

Similar Papers 제목 키워드 기반

Semi-supervised Gender Classification with Joint Textual and Social Modeling

2016-12-01 · COLING 2016 12 · Shoushan Li, Bin Dai, ZhengXian Gong, Guodong Zhou

In gender classification, labeled data is often limited while unlabeled data is ample. This motivates semi-supervised learning for gender classification to improve the performance by exploring the knowledge in both label…

ClassificationGender ClassificationGeneral Classification

Semi-Supervising Learning, Transfer Learning, and Knowledge Distillation with SimCLR

2021-08-02 · Khoi Nguyen, Yen Nguyen, Bao Le

Recent breakthroughs in the field of semi-supervised learning have achieved results that match state-of-the-art traditional supervised learning methods. Most successful semi-supervised learning approaches in computer vis…

Data AugmentationKnowledge DistillationTransfer Learning

The Impact of Semi-Supervised Learning on Line Segment Detection

2024-11-07 · Johanna Engman, Karl Åström, Magnus Oskarsson

In this paper we present a method for line segment detection in images, based on a semi-supervised framework. Leveraging the use of a consistency loss based on differently augmented and perturbed unlabeled images with a …

Line DetectionLine Segment Detection

Context-Based Semantic-Aware Alignment for Semi-Supervised Multi-Label Learning

2024-12-25 · Heng-Bo Fan, Ming-Kun Xie, Jia-Hao Xiao, Sheng-Jun Huang

Due to the lack of extensive precisely-annotated multi-label data in real word, semi-supervised multi-label learning (SSMLL) has gradually gained attention. Abundant knowledge embedded in vision-language models (VLMs) pr…

Multi-Label Learning

Knowledge Assembly: Semi-Supervised Multi-Task Learning from Multiple Datasets with Disjoint Labels

2023-06-15 · Federica Spinola, Philipp Benz, Minhyeong Yu, Tae-hoon Kim

In real-world scenarios we often need to perform multiple tasks simultaneously. Multi-Task Learning (MTL) is an adequate method to do so, but usually requires datasets labeled for all tasks. We propose a method that can …

AttributeMulti-Task LearningPedestrian Attribute RecognitionPerson Re-Identification