Learning Statistical Texture for Semantic Segmentation
Existing semantic segmentation works mainly focus on learning the contextual information in high-level semantic features with CNNs. In order to maintain a precise boundary, low-level texture features are directly skip-connected into the deeper layers. Nevertheless, texture features are not only about local structure, but also include global statistical knowledge of the input image. In this paper, we fully take advantages of the low-level texture features and propose a novel Statistical Texture Learning Network (STLNet) for semantic segmentation. For the first time, STLNet analyzes the distribution of low level information and efficiently utilizes them for the task. Specifically, a novel Quantization and Counting Operator (QCO) is designed to describe the texture information in a statistical manner. Based on QCO, two modules are introduced: (1) Texture Enhance Module (TEM), to capture texture-related information and enhance the texture details; (2) Pyramid Texture Feature Extraction Module (PTFEM), to effectively extract the statistical texture features from multiple scales. Through extensive experiments, we show that the proposed STLNet achieves state-of-the-art performance on three semantic segmentation benchmarks: Cityscapes, PASCAL Context and ADE20K.
Code (1)
Tasks
QuantizationSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Structural and Statistical Texture Knowledge Distillation for Semantic Segmentation
Existing knowledge distillation works for semantic segmentation mainly focus on transferring high-level contextual knowledge from teacher to student. However, low-level texture knowledge is also of vital importance for c…
Knowledge DistillationQuantizationSemantic SegmentationSkinFormer: Learning Statistical Texture Representation with Transformer for Skin Lesion Segmentation
Accurate skin lesion segmentation from dermoscopic images is of great importance for skin cancer diagnosis. However, automatic segmentation of melanoma remains a challenging task because it is difficult to incorporate us…
Lesion SegmentationSegmentationSkin Lesion SegmentationTexture Based Image Segmentation of Chili Pepper X-Ray Images Using Gabor Filter
Texture segmentation is the process of partitioning an image into regions with different textures containing a similar group of pixels. Detecting the discontinuity of the filter's output and their statistical properties …
Image SegmentationSegmentationSemantic SegmentationTexture ClassificationTextureSAM: Towards a Texture Aware Foundation Model for Segmentation
Segment Anything Models (SAM) have achieved remarkable success in object segmentation tasks across diverse datasets. However, these models are predominantly trained on large-scale semantic segmentation datasets, which in…
Material ClassificationObjectSegmentationSemantic SegmentationSub-Semantic Image Segmentation
Images can be segmented based on visual cues (i.e., texture segmentation) or into objects (i.e., semantic segmentation). We propose a new category of sub-semantic image segmentation that blurs the line between the two. I…
Semantic SegmentationImage Segmentation