paper-with-me

홈 › Papers

Few-Shot Semantic Segmentation Augmented with Image-Level Weak Annotations

2020-07-03 · Shuo Lei, Xuchao Zhang, Jianfeng He, Fanglan Chen, Chang-Tien Lu

Despite the great progress made by deep neural networks in the semantic segmentation task, traditional neural-networkbased methods typically suffer from a shortage of large amounts of pixel-level annotations. Recent progress in fewshot semantic segmentation tackles the issue by only a few pixel-level annotated examples. However, these few-shot approaches cannot easily be applied to multi-way or weak annotation settings. In this paper, we advance the few-shot segmentation paradigm towards a scenario where image-level annotations are available to help the training process of a few pixel-level annotations. Our key idea is to learn a better prototype representation of the class by fusing the knowledge from the image-level labeled data. Specifically, we propose a new framework, called PAIA, to learn the class prototype representation in a metric space by integrating image-level annotations. Furthermore, by considering the uncertainty of pseudo-masks, a distilled soft masked average pooling strategy is designed to handle distractions in image-level annotations. Extensive empirical results on two datasets show superior performance of PAIA.

📄 PDF Abstract BibTeX arXiv:2007.01496

Code (0)

등록된 구현이 없습니다.

Tasks

Few-Shot Semantic SegmentationSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

Average Pooling 설명 없음

Similar Papers 제목 키워드 기반

Retrieve and Segment: Are a Few Examples Enough to Bridge the Supervision Gap in Open-Vocabulary Segmentation?

2026-02-26 · Tilemachos Aravanis, Vladan Stojnić, Bill Psomas, Nikos Komodakis 외 arxiv

Open-vocabulary segmentation (OVS) extends the zero-shot recognition capabilities of vision-language models (VLMs) to pixel-level prediction, enabling segmentation of arbitrary categories specified by text prompts. Despi…

Personalized Segmentation

Text Augmented Spatial-aware Zero-shot Referring Image Segmentation

2023-10-27 · Yucheng Suo, Linchao Zhu, Yi Yang

In this paper, we study a challenging task of zero-shot referring image segmentation. This task aims to identify the instance mask that is most related to a referring expression without training on pixel-level annotation…

Image SegmentationReferring ExpressionSegmentationSemantic Segmentation+2

Weakly Supervised Few-shot Object Segmentation using Co-Attention with Visual and Semantic Embeddings

2020-01-26 · Mennatullah Siam, Naren Doraiswamy, Boris N. Oreshkin, Hengshuai Yao 외

Significant progress has been made recently in developing few-shot object segmentation methods. Learning is shown to be successful in few-shot segmentation settings, using pixel-level, scribbles and bounding box supervis…

Few-Shot LearningObjectOne-shot visual object segmentationSegmentation+3

ObjectAug: Object-level Data Augmentation for Semantic Image Segmentation

2021-01-30 · Jiawei Zhang, Yanchun Zhang, Xiaowei Xu

Semantic image segmentation aims to obtain object labels with precise boundaries, which usually suffers from overfitting. Recently, various data augmentation strategies like regional dropout and mix strategies have been …

Data AugmentationImage InpaintingImage SegmentationObject+2

Exploring Regional Clues in CLIP for Zero-Shot Semantic Segmentation

2024-01-01 · CVPR 2024 1 · Yi Zhang, Meng-Hao Guo, Miao Wang, Shi-Min Hu

CLIP has demonstrated marked progress in visual recognition due to its powerful pre-training on large-scale image-text pairs. However it still remains a critical challenge: how to transfer image-level knowledge into …

SegmentationSemantic SegmentationZero-Shot Semantic Segmentation