paper-with-me

홈 › Papers

Exploiting DINOv3-Based Self-Supervised Features for Robust Few-Shot Medical Image Segmentation

2026-01-12 · Guoping Xu, Jayaram K. Udupa, Weiguo Lu, You Zhang arxiv

Deep learning-based automatic medical image segmentation plays a critical role in clinical diagnosis and treatment planning but remains challenging in few-shot scenarios due to the scarcity of annotated training data. Recently, self-supervised foundation models such as DINOv3, which were trained on large natural image datasets, have shown strong potential for dense feature extraction that can help with the few-shot learning challenge. Yet, their direct application to medical images is hindered by domain differences. In this work, we propose DINO-AugSeg, a novel framework that leverages DINOv3 features to address the few-shot medical image segmentation challenge. Specifically, we introduce WT-Aug, a wavelet-based feature-level augmentation module that enriches the diversity of DINOv3-extracted features by perturbing frequency components, and CG-Fuse, a contextual information-guided fusion module that exploits cross-attention to integrate semantic-rich low-resolution features with spatially detailed high-resolution features. Extensive experiments on six public benchmarks spanning five imaging modalities, including MRI, CT, ultrasound, endoscopy, and dermoscopy, demonstrate that DINO-AugSeg consistently outperforms existing methods under limited-sample conditions. The results highlight the effectiveness of incorporating wavelet-domain augmentation and contextual fusion for robust feature representation, suggesting DINO-AugSeg as a promising direction for advancing few-shot medical image segmentation. Code and data will be made available on https://github.com/apple1986/DINO-AugSeg.

📄 PDF Abstract BibTeX arXiv:2601.08078

Code (0)

등록된 구현이 없습니다.

Tasks

Medical Image SegmentationFew-Shot Learning

Similar Papers 제목 키워드 기반

DINOv2 based Self Supervised Learning For Few Shot Medical Image Segmentation

2024-03-05 · Lev Ayzenberg, Raja Giryes, Hayit Greenspan

Deep learning models have emerged as the cornerstone of medical image segmentation, but their efficacy hinges on the availability of extensive manually labeled datasets and their adaptability to unforeseen categories rem…

Image SegmentationMedical Image AnalysisMedical Image SegmentationSegmentation+2

Revealing the Semantic Selection Gap in DINOv3 through Training-Free Few-Shot Segmentation

2026-02-07 · Hussni Mohd Zakir, Eric Tatt Wei Ho arxiv

Recent self-supervised Vision Transformers (ViTs), such as DINOv3, provide rich feature representations for dense vision tasks. This study investigates the intrinsic few-shot semantic segmentation (FSS) capabilities of f…

Few-Shot Semantic SegmentationTest-time Adaptation

INSID3: Training-Free In-Context Segmentation with DINOv3

2026-03-30 · Claudia Cuttano, Gabriele Trivigno, Christoph Reich, Daniel Cremers 외 arxiv

In-context segmentation (ICS) aims to segment arbitrary concepts, e.g., objects, parts, or personalized instances, given one annotated visual examples. Existing work relies on (i) fine-tuning vision foundation models (VF…

Personalized SegmentationSemantic correspondence

Evaluating General Purpose Vision Foundation Models for Medical Image Analysis: An Experimental Study of DINOv2 on Radiology Benchmarks

2023-12-04 · Mohammed Baharoon, Waseem Qureshi, Jiahong Ouyang, Yanwu Xu 외

The integration of deep learning systems into healthcare has been hindered by the resource-intensive process of data annotation and the inability of these systems to generalize to different data distributions. Foundation…

Few-Shot LearningMedical Image AnalysisOrgan Segmentationparameter-efficient fine-tuning+1

Emergent Region-Level Facial Correspondence in Frozen Vision Foundation Models

2026-07-15 · Izaldein Al-Zyoud, Abdulmotaleb El Saddik arxiv

Frozen self-supervised vision models can align parts of generic objects, but it remains unclear whether this correspondence extends to human faces, where global layout is shared while identity-specific appearance varies …