Adaptive Spatial Augmentation for Semi-supervised Semantic Segmentation
In semi-supervised semantic segmentation (SSSS), data augmentation plays a crucial role in the weak-to-strong consistency regularization framework, as it enhances diversity and improves model generalization. Recent strong augmentation methods have primarily focused on intensity-based perturbations, which have minimal impact on the semantic masks. In contrast, spatial augmentations like translation and rotation have long been acknowledged for their effectiveness in supervised semantic segmentation tasks, but they are often ignored in SSSS. In this work, we demonstrate that spatial augmentation can also contribute to model training in SSSS, despite generating inconsistent masks between the weak and strong augmentations. Furthermore, recognizing the variability among images, we propose an adaptive augmentation strategy that dynamically adjusts the augmentation for each instance based on entropy. Extensive experiments show that our proposed Adaptive Spatial Augmentation (\textbf{ASAug}) can be integrated as a pluggable module, consistently improving the performance of existing methods and achieving state-of-the-art results on benchmark datasets such as PASCAL VOC 2012, Cityscapes, and COCO.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationDiversitySemantic SegmentationSemi-Supervised Semantic SegmentationSimilar Papers 제목 키워드 기반
Colour augmentation for improved semi-supervised semantic segmentation
Consistency regularization describes a class of approaches that have yielded state-of-the-art results for semi-supervised classification. While semi-supervised semantic segmentation proved to be more challenging, a numbe…
ClassificationSegmentationSelf-Supervised LearningSemantic Segmentation+1Learning Where to Learn in Cross-View Self-Supervised Learning
Self-supervised learning (SSL) has made enormous progress and largely narrowed the gap with the supervised ones, where the representation learning is mainly guided by a projection into an embedding space. During the proj…
object-detectionObject DetectionRepresentation LearningSelf-Supervised Learning+1Bidirectional Channel-selective Semantic Interaction for Semi-Supervised Medical Segmentation
Semi-supervised medical image segmentation is an effective method for addressing scenarios with limited labeled data. Existing methods mainly rely on frameworks such as mean teacher and dual-stream consistency learning. …
Semi-supervised Medical Image SegmentationAugmentation Matters: A Simple-yet-Effective Approach to Semi-supervised Semantic Segmentation
Recent studies on semi-supervised semantic segmentation (SSS) have seen fast progress. Despite their promising performance, current state-of-the-art methods tend to increasingly complex designs at the cost of introducing…
Semantic SegmentationSemi-Supervised Semantic SegmentationTransMedSeg: A Transferable Semantic Framework for Semi-Supervised Medical Image Segmentation
Semi-supervised learning (SSL) has achieved significant progress in medical image segmentation (SSMIS) through effective utilization of limited labeled data. While current SSL methods for medical images predominantly rel…
Image SegmentationMedical Image AnalysisMedical Image SegmentationRepresentation Learning+2