paper-with-me

홈 › Papers

Context-aware Feature Generation for Zero-shot Semantic Segmentation

2020-08-16 · Zhangxuan Gu, Siyuan Zhou, Li Niu, Zihan Zhao, Liqing Zhang

Existing semantic segmentation models heavily rely on dense pixel-wise annotations. To reduce the annotation pressure, we focus on a challenging task named zero-shot semantic segmentation, which aims to segment unseen objects with zero annotations. This task can be accomplished by transferring knowledge across categories via semantic word embeddings. In this paper, we propose a novel context-aware feature generation method for zero-shot segmentation named CaGNet. In particular, with the observation that a pixel-wise feature highly depends on its contextual information, we insert a contextual module in a segmentation network to capture the pixel-wise contextual information, which guides the process of generating more diverse and context-aware features from semantic word embeddings. Our method achieves state-of-the-art results on three benchmark datasets for zero-shot segmentation. Codes are available at: https://github.com/bcmi/CaGNet-Zero-Shot-Semantic-Segmentation.

📄 PDF Abstract BibTeX arXiv:2008.06893

Code (2)

bcmi/CaGNet-Zero-Shot-Semantic-Segmentation 공식 구현 pytorch
bcmi/CaGNetv2-Zero-Shot-Semantic-Segmentation pytorch

Tasks

SegmentationSemantic SegmentationWord EmbeddingsZero Shot SegmentationZero-Shot Semantic Segmentation

Similar Papers 제목 키워드 기반

From Pixel to Patch: Synthesize Context-aware Features for Zero-shot Semantic Segmentation

2020-09-25 · Zhangxuan Gu, Siyuan Zhou, Li Niu, Zihan Zhao 외

Zero-shot learning has been actively studied for image classification task to relieve the burden of annotating image labels. Interestingly, semantic segmentation task requires more labor-intensive pixel-wise annotation, …

image-classificationImage ClassificationSegmentationSemantic Segmentation+2

UniFa: A unified feature hallucination framework for any-shot object detection

2025-03-01 · journal 2025 3 · Hui Nie, Ruiping Wang, Xilin Chen

Any-shot object detection seeks to simultaneously detect base (many-shot), few-shot and zero-shot categories. The primary challenge lies in insufficient visual data for rare (few-shot and zero-shot) categories, hindering…

Generalized Zero-Shot Object DetectionHallucinationobject-detectionObject Detection+1

Context-Aware Zero-Shot Anomaly Detection in Surveillance Using Contrastive and Predictive Spatiotemporal Modeling

2025-08-25 · Md. Rashid Shahriar Khan, Md. Abrar Hasan, Mohammod Tareq Aziz Justice arxiv

Detecting anomalies in surveillance footage is inherently challenging due to their unpredictable and context-dependent nature. This work introduces a novel context-aware zero-shot anomaly detection framework that identif…

Anomaly Detection

StreamVoice: Streamable Context-Aware Language Modeling for Real-time Zero-Shot Voice Conversion

2024-01-19 · Zhichao Wang, Yuanzhe Chen, Xinsheng Wang, Lei Xie 외

Recent language model (LM) advancements have showcased impressive zero-shot voice conversion (VC) performance. However, existing LM-based VC models usually apply offline conversion from source semantics to acoustic featu…

Language ModelingLanguage ModellingVoice Conversion

Zero-Shot Industrial Anomaly Segmentation with Image-Aware Prompt Generation

2025-04-18 · Soyoung Park, Hyewon Lee, MinGyu Choi, SeungHoon Han 외

Anomaly segmentation is essential for industrial quality, maintenance, and stability. Existing text-guided zero-shot anomaly segmentation models are effective but rely on fixed prompts, limiting adaptability in diverse i…

Anomaly SegmentationLanguage ModelingLanguage ModellingLarge Language Model+1