paper-with-me

Papers

SemSim: Revisiting Weak-to-Strong Consistency from a Semantic Similarity Perspective for Semi-supervised Medical Image Segmentation

2024-10-17 · Shiao Xie, Hongyi Wang, Ziwei Niu, Hao Sun, Shuyi Ouyang, Yen-Wei Chen, Lanfen Lin

Semi-supervised learning (SSL) for medical image segmentation is a challenging yet highly practical task, which reduces reliance on large-scale labeled dataset by leveraging unlabeled samples. Among SSL techniques, the weak-to-strong consistency framework, popularized by FixMatch, has emerged as a state-of-the-art method in classification tasks. Notably, such a simple pipeline has also shown competitive performance in medical image segmentation. However, two key limitations still persist, impeding its efficient adaptation: (1) the neglect of contextual dependencies results in inconsistent predictions for similar semantic features, leading to incomplete object segmentation; (2) the lack of exploitation of semantic similarity between labeled and unlabeled data induces considerable class-distribution discrepancy. To address these limitations, we propose a novel semi-supervised framework based on FixMatch, named SemSim, powered by two appealing designs from semantic similarity perspective: (1) rectifying pixel-wise prediction by reasoning about the intra-image pair-wise affinity map, thus integrating contextual dependencies explicitly into the final prediction; (2) bridging labeled and unlabeled data via a feature querying mechanism for compact class representation learning, which fully considers cross-image anatomical similarities. As the reliable semantic similarity extraction depends on robust features, we further introduce an effective spatial-aware fusion module (SFM) to explore distinctive information from multiple scales. Extensive experiments show that SemSim yields consistent improvements over the state-of-the-art methods across three public segmentation benchmarks.

📄 PDF Abstract BibTeX arXiv:2410.13486

Code (0)

등록된 구현이 없습니다.

Tasks

Image SegmentationMedical Image SegmentationRepresentation LearningSegmentationSemantic SegmentationSemantic SimilaritySemantic Textual SimilaritySemi-supervised Medical Image Segmentation

Methods 이 논문이 사용한 방법론

FixMatch FixMatch is an algorithm that first generates pseudo-labels using the model's predictions on weakly-augmented unlabeled images. For a given image, the pseudo-label is only…

Similar Papers 제목 키워드 기반

Revisiting Network Perturbation for Semi-Supervised Semantic Segmentation

2024-11-08 · Sien Li, Tao Wang, Ruizhe Hu, Wenxi Liu

In semi-supervised semantic segmentation (SSS), weak-to-strong consistency regularization techniques are widely utilized in recent works, typically combined with input-level and feature-level perturbations. However, the …

Semantic SegmentationSemi-Supervised Semantic Segmentation

Privacy Assessment on Reconstructed Images: Are Existing Evaluation Metrics Faithful to Human Perception?

2023-09-22 · NeurIPS 2023 11

Hand-crafted image quality metrics, such as PSNR and SSIM, are commonly used to evaluate model privacy risk under reconstruction attacks. Under these metrics, reconstructed images that are determined to resemble the orig…

Semantic SimilaritySemantic Textual SimilaritySSIMTriplet

A Parametric Similarity Method: Comparative Experiments based on Semantically Annotated Large Datasets

2023-02-08 · Antonio De Nicola, Anna Formica, Michele Missikoff, Elaheh Pourabbas 외

We present the parametric method SemSimp aimed at measuring semantic similarity of digital resources. SemSimp is based on the notion of information content, and it leverages a reference ontology and taxonomic reasoning, …

Semantic SimilaritySemantic Textual Similarity

UMCC\_DLSI\_SemSim: Multilingual System for Measuring Semantic Textual Similarity

2014-08-01 · SEMEVAL 2014 8 · Alex Ch{\'a}vez, er, H{\'e}ctor D{\'a}vila, Yoan Guti{\'e}rrez 외
Document ClassificationMachine TranslationSemantic Textual Similarity

NORMAS at SemEval-2016 Task 1: SEMSIM: A Multi-Feature Approach to Semantic Text Similarity

2016-06-01 · SEMEVAL 2016 6 · Kolawole Adebayo, Luigi di Caro, Guido Boella
Machine TranslationSemantic Textual Similaritytext similarityText Summarization