paper-with-me

Papers

DiM: $f$-Divergence Minimization Guided Sharpness-Aware Optimization for Semi-supervised Medical Image Segmentation

2024-11-19 · Bingli Wang, Houcheng Su, Nan Yin, Mengzhu Wang, Li Shen

As a technique to alleviate the pressure of data annotation, semi-supervised learning (SSL) has attracted widespread attention. In the specific domain of medical image segmentation, semi-supervised methods (SSMIS) have become a research hotspot due to their ability to reduce the need for large amounts of precisely annotated data. SSMIS focuses on enhancing the model's generalization performance by leveraging a small number of labeled samples and a large number of unlabeled samples. The latest sharpness-aware optimization (SAM) technique, which optimizes the model by reducing the sharpness of the loss function, has shown significant success in SSMIS. However, SAM and its variants may not fully account for the distribution differences between different datasets. To address this issue, we propose a sharpness-aware optimization method based on $f$-divergence minimization (DiM) for semi-supervised medical image segmentation. This method enhances the model's stability by fine-tuning the sensitivity of model parameters and improves the model's adaptability to different datasets through the introduction of $f$-divergence. By reducing $f$-divergence, the DiM method not only improves the performance balance between the source and target datasets but also prevents performance degradation due to overfitting on the source dataset.

📄 PDF Abstract BibTeX arXiv:2411.12350

Code (0)

등록된 구현이 없습니다.

Tasks

Image SegmentationMedical Image SegmentationSemantic SegmentationSemi-supervised Medical Image Segmentation

Methods 이 논문이 사용한 방법론

SAM 설명 없음

Similar Papers 제목 키워드 기반

Model Generalization: A Sharpness Aware Optimization Perspective

2022-08-14 · Jozef Marus Coldenhoff, Chengkun Li, Yurui Zhu

Sharpness-Aware Minimization (SAM) and adaptive sharpness-aware minimization (ASAM) aim to improve the model generalization. And in this project, we proposed three experiments to valid their generalization from the sharp…

modelvalid

RSAM: Learning on manifolds with Riemannian Sharpness-aware Minimization

2023-09-29 · Tuan Truong, Hoang-Phi Nguyen, Tung Pham, Minh-Tuan Tran 외

Nowadays, understanding the geometry of the loss landscape shows promise in enhancing a model's generalization ability. In this work, we draw upon prior works that apply geometric principles to optimization and present a…

Contrastive Learningimage-classificationImage Classification

FEDTAIL: Federated Long-Tailed Domain Generalization with Sharpness-Guided Gradient Matching

2025-06-10 · Sunny Gupta, Nikita Jangid, Shounak Das, Amit Sethi

Domain Generalization (DG) seeks to train models that perform reliably on unseen target domains without access to target data during training. While recent progress in smoothing the loss landscape has improved generaliza…

Domain Generalization

NCSAM Noise-Compensated Sharpness-Aware Minimization for Noisy Label Learning

2026-01-24 · Jiayu Xu, Junbiao Pang arxiv

Learning from Noisy Labels (LNL) remains a fundamental challenge in deep learning because real-world datasets often contain corrupted annotations. Most existing methods rely on label correction or sample selection mechan…

1st-Order Magic: Analysis of Sharpness-Aware Minimization

2024-11-03 · Nalin Tiwary, Siddarth Aananth

Sharpness-Aware Minimization (SAM) is an optimization technique designed to improve generalization by favoring flatter loss minima. To achieve this, SAM optimizes a modified objective that penalizes sharpness, using comp…