paper-with-me

홈 › Papers

Semantic-Guided Multi-Attention Localization for Zero-Shot Learning

2019-03-01 · NeurIPS 2019 12 · Yizhe Zhu, Jianwen Xie, Zhiqiang Tang, Xi Peng, Ahmed Elgammal

Zero-shot learning extends the conventional object classification to the unseen class recognition by introducing semantic representations of classes. Existing approaches predominantly focus on learning the proper mapping function for visual-semantic embedding, while neglecting the effect of learning discriminative visual features. In this paper, we study the significance of the discriminative region localization. We propose a semantic-guided multi-attention localization model, which automatically discovers the most discriminative parts of objects for zero-shot learning without any human annotations. Our model jointly learns cooperative global and local features from the whole object as well as the detected parts to categorize objects based on semantic descriptions. Moreover, with the joint supervision of embedding softmax loss and class-center triplet loss, the model is encouraged to learn features with high inter-class dispersion and intra-class compactness. Through comprehensive experiments on three widely used zero-shot learning benchmarks, we show the efficacy of the multi-attention localization and our proposed approach improves the state-of-the-art results by a considerable margin.

📄 PDF Abstract BibTeX arXiv:1903.00502

Code (0)

등록된 구현이 없습니다.

Tasks

TripletZero-Shot Learning

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

TransZero++: Cross Attribute-Guided Transformer for Zero-Shot Learning

2021-12-16 · Shiming Chen, Ziming Hong, Wenjin Hou, Guo-Sen Xie 외

Zero-shot learning (ZSL) tackles the novel class recognition problem by transferring semantic knowledge from seen classes to unseen ones. Existing attention-based models have struggled to learn inferior region features i…

AttributeDecoderZero-Shot Learning

TransZero: Attribute-guided Transformer for Zero-Shot Learning

2021-12-03 · Shiming Chen, Ziming Hong, Yang Liu, Guo-Sen Xie 외

Zero-shot learning (ZSL) aims to recognize novel classes by transferring semantic knowledge from seen classes to unseen ones. Semantic knowledge is learned from attribute descriptions shared between different classes, wh…

AttributeDecoderZero-Shot Learning

AG-VAS: Anchor-Guided Zero-Shot Visual Anomaly Segmentation with Large Multimodal Models

2026-03-01 · Zhen Qu, Xian Tao, Xiaoyi Bao, Dingrong Wang 외 arxiv

Large multimodal models (LMMs) exhibit strong task generalization capabilities, offering new opportunities for zero-shot visual anomaly segmentation (ZSAS). However, existing LMM-based segmentation approaches still face …

Goal-Oriented Gaze Estimation for Zero-Shot Learning

2021-03-05 · CVPR 2021 1 · Yang Liu, Lei Zhou, Xiao Bai, Yifei HUANG 외

Zero-shot learning (ZSL) aims to recognize novel classes by transferring semantic knowledge from seen classes to unseen classes. Since semantic knowledge is built on attributes shared between different classes, which are…

AttributeGaze EstimationGeneralized Zero-Shot LearningZero-Shot Learning

Multimodal Query-guided Object Localization

2022-12-01 · Aditay Tripathi, Rajath R Dani, Anand Mishra, Anirban Chakraborty

Consider a scenario in one-shot query-guided object localization where neither an image of the object nor the object category name is available as a query. In such a scenario, a hand-drawn sketch of the object could be a…

ObjectObject LocalizationRegion Proposal