paper-with-me

Papers

ScribbleVC: Scribble-supervised Medical Image Segmentation with Vision-Class Embedding

2023-07-30 · Zihan Li, Yuan Zheng, Xiangde Luo, Dandan Shan, Qingqi Hong

Medical image segmentation plays a critical role in clinical decision-making, treatment planning, and disease monitoring. However, accurate segmentation of medical images is challenging due to several factors, such as the lack of high-quality annotation, imaging noise, and anatomical differences across patients. In addition, there is still a considerable gap in performance between the existing label-efficient methods and fully-supervised methods. To address the above challenges, we propose ScribbleVC, a novel framework for scribble-supervised medical image segmentation that leverages vision and class embeddings via the multimodal information enhancement mechanism. In addition, ScribbleVC uniformly utilizes the CNN features and Transformer features to achieve better visual feature extraction. The proposed method combines a scribble-based approach with a segmentation network and a class-embedding module to produce accurate segmentation masks. We evaluate ScribbleVC on three benchmark datasets and compare it with state-of-the-art methods. The experimental results demonstrate that our method outperforms existing approaches in terms of accuracy, robustness, and efficiency. The datasets and code are released on GitHub.

📄 PDF Abstract BibTeX arXiv:2307.16226

Code (1)

huanglizi/scribblevc 공식 구현 pytorch

Tasks

Decision MakingImage SegmentationMedical Image SegmentationSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Position-Wise Feed-Forward Layer 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

Bi-Level Collaborative Learning for Few-Shot Scribble-Supervised Medical Image Segmentation

2026-07-28 · Xiang-Xiang Su, Yufan Ye, Yihang Zheng, Min Gan 외 arxiv

Scribble annotations offer an efficient alternative to costly pixel-wise labeling for medical image segmentation, yet in real clinical scenarios, scribble-annotated samples are often still limited, imposing the dual chal…

Medical Image Segmentation

Scribble-Supervised Medical Image Segmentation via Dual-Branch Network and Dynamically Mixed Pseudo Labels Supervision

2022-03-04 · Xiangde Luo, Minhao Hu, Wenjun Liao, Shuwei Zhai 외

Medical image segmentation plays an irreplaceable role in computer-assisted diagnosis, treatment planning, and following-up. Collecting and annotating a large-scale dataset is crucial to training a powerful segmentation …

Image SegmentationMedical Image SegmentationMRI segmentationSegmentation+2

ScribbleVS: Scribble-Supervised Medical Image Segmentation via Dynamic Competitive Pseudo Label Selection

2024-11-15 · Tao Wang, Xinlin Zhang, Yuanbin Chen, Yuanbo Zhou 외

In clinical medicine, precise image segmentation can provide substantial support to clinicians. However, achieving such precision often requires a large amount of finely annotated data, which can be costly. Scribble anno…

Image SegmentationMedical Image SegmentationPseudo LabelSemantic Segmentation

CycleMix: A Holistic Strategy for Medical Image Segmentation from Scribble Supervision

2022-03-03 · CVPR 2022 1 · Ke Zhang, Xiahai Zhuang

Curating a large set of fully annotated training data can be costly, especially for the tasks of medical image segmentation. Scribble, a weaker form of annotation, is more obtainable in practice, but training segmentatio…

Image SegmentationMedical Image SegmentationSegmentationSemantic Segmentation

Volumetric Medical Image Segmentation via Scribble Annotations and Shape Priors

2023-10-12 · Qiuhui Chen, Haiying Lyu, Xinyue Hu, Yong Lu 외

Recently, weakly-supervised image segmentation using weak annotations like scribbles has gained great attention in computer vision and medical image analysis, since such annotations are much easier to obtain compared to …

Image SegmentationMedical Image AnalysisMedical Image SegmentationSegmentation+2