Robust Semantic Segmentation with Superpixel-Mix
Along with predictive performance and runtime speed, reliability is a key requirement for real-world semantic segmentation. Reliability encompasses robustness, predictive uncertainty and reduced bias. To improve reliability, we introduce Superpixel-mix, a new superpixel-based data augmentation method with teacher-student consistency training. Unlike other mixing-based augmentation techniques, mixing superpixels between images is aware of object boundaries, while yielding consistent gains in segmentation accuracy. Our proposed technique achieves state-of-the-art results in semi-supervised semantic segmentation on the Cityscapes dataset. Moreover, Superpixel-mix improves the reliability of semantic segmentation by reducing network uncertainty and bias, as confirmed by competitive results under strong distributions shift (adverse weather, image corruptions) and when facing out-of-distribution data.
Code (2)
Tasks
Data AugmentationSegmentationSemantic SegmentationSemi-Supervised Semantic SegmentationSuperpixelsMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Adaptive Superpixel for Active Learning in Semantic Segmentation
Learning semantic segmentation requires pixel-wise annotations, which can be time-consuming and expensive. To reduce the annotation cost, we propose a superpixel-based active learning (AL) framework, which collects a dom…
Active LearningSegmentationSemantic SegmentationSuperpixelsSuperpixel Transformers for Efficient Semantic Segmentation
Semantic segmentation, which aims to classify every pixel in an image, is a key task in machine perception, with many applications across robotics and autonomous driving. Due to the high dimensionality of this task, most…
Autonomous DrivingSegmentationSemantic SegmentationSuperpixelsRe-purposing SAM into Efficient Visual Projectors for MLLM-Based Referring Image Segmentation
Recently, Referring Image Segmentation (RIS) frameworks that pair the Multimodal Large Language Model (MLLM) with the Segment Anything Model (SAM) have achieved impressive results. However, adapting MLLM to segmentation …
Image SegmentationGenerating superpixels using deep image representations
Superpixel algorithms are a common pre-processing step for computer vision algorithms such as segmentation, object tracking and localization. Many superpixel methods only rely on colors features for segmentation, limitin…
ClusteringGeneral ClassificationObjectObject Tracking+3Revisiting Superpixels for Active Learning in Semantic Segmentation With Realistic Annotation Costs
State-of-the-art methods for semantic segmentation are based on deep neural networks that are known to be data-hungry. Region-based active learning has shown to be a promising method for reducing data annotation cost…
Active LearningSemantic SegmentationSuperpixels