SAM2LoRA: Composite Loss-Guided, Parameter-Efficient Finetuning of SAM2 for Retinal Fundus Segmentation

2025-10-11 · Sayan Mandal, Divyadarshini Karthikeyan, Manas Paldhe arxiv

We propose SAM2LoRA, a parameter-efficient fine-tuning strategy that adapts the Segment Anything Model 2 (SAM2) for fundus image segmentation. SAM2 employs a masked autoencoder-pretrained Hierarchical Vision Transformer for multi-scale feature decoding, enabling rapid inference in low-resource settings; however, fine-tuning remains challenging. To address this, SAM2LoRA integrates a low-rank adapter into both the image encoder and mask decoder, requiring fewer than 5\% of the original trainable parameters. Our analysis indicates that for cross-dataset fundus segmentation tasks, a composite loss function combining segmentationBCE, SoftDice, and FocalTversky losses is essential for optimal network tuning. Evaluated on 11 challenging fundus segmentation datasets, SAM2LoRA demonstrates high performance in both blood vessel and optic disc segmentation under cross-dataset training conditions. It achieves Dice scores of up to 0.86 and 0.93 for blood vessel and optic disc segmentation, respectively, and AUC values of up to 0.98 and 0.99, achieving state-of-the-art performance while substantially reducing training overhead.

📄 PDF Abstract BibTeX arXiv:2510.10288

Code (0)

등록된 구현이 없습니다.

Tasks

parameter-efficient fine-tuning Image Segmentation

qa-FLoRA: Data-free query-adaptive Fusion of LoRAs for LLMs

2025-12-12 · Shreya Shukla, Aditya Sriram, Milinda Kuppur Narayanaswamy, Hiteshi Jain arxiv

The deployment of large language models for specialized tasks often requires domain-specific parameter-efficient finetuning through Low-Rank Adaptation (LoRA) modules. However, effectively fusing these adapters to handle…

Domain Adaptation

MiLoRA: Harnessing Minor Singular Components for Parameter-Efficient LLM Finetuning

2024-06-13 · Hanqing Wang, Yixia Li, Shuo Wang, Guanhua Chen 외

Efficient finetuning of large language models (LLMs) aims to adapt the LLMs with reduced computational and memory cost. Previous LoRA-based approaches initialize the low-rank matrices with Gaussian distribution and zero …

Instruction Following Math visual instruction following

AlignGuard-LoRA: Alignment-Preserving Fine-Tuning via Fisher-Guided Decomposition and Riemannian-Geodesic Collision Regularization

2025-08-04 · Amitava Das, Abhilekh Borah, Vinija Jain, Aman Chadha arxiv

Low-rank adaptation (LoRA) has become a standard tool for efficiently fine-tuning large language models (LLMs). Yet, even minor LoRA updates can induce alignment drift, weakening safety and behavioral constraints through…

ReMix: Reinforcement routing for mixtures of LoRAs in LLM finetuning

2026-03-10 · Ruizhong Qiu, Hanqing Zeng, Yinglong Xia, Yiwen Meng 외 arxiv

Low-rank adapters (LoRAs) are a parameter-efficient finetuning technique that injects trainable low-rank matrices into pretrained models to adapt them to new tasks. Mixture-of-LoRAs models expand neural networks efficien…

Reinforcement Learning

MoS: Unleashing Parameter Efficiency of Low-Rank Adaptation with Mixture of Shards

2024-10-01 · Sheng Wang, Liheng Chen, Pengan Chen, Jingwei Dong 외

The rapid scaling of large language models necessitates more lightweight finetuning methods to reduce the explosive GPU memory overhead when numerous customized models are served simultaneously. Targeting more parameter-…

GPU Mixture-of-Experts