paper-with-me

Papers

A Generative Adversarial Approach for Zero-Shot Learning from Noisy Texts

2017-12-04 · CVPR 2018 6 · Yizhe Zhu, Mohamed Elhoseiny, Bingchen Liu, Xi Peng, Ahmed Elgammal

Most existing zero-shot learning methods consider the problem as a visual semantic embedding one. Given the demonstrated capability of Generative Adversarial Networks(GANs) to generate images, we instead leverage GANs to imagine unseen categories from text descriptions and hence recognize novel classes with no examples being seen. Specifically, we propose a simple yet effective generative model that takes as input noisy text descriptions about an unseen class (e.g.Wikipedia articles) and generates synthesized visual features for this class. With added pseudo data, zero-shot learning is naturally converted to a traditional classification problem. Additionally, to preserve the inter-class discrimination of the generated features, a visual pivot regularization is proposed as an explicit supervision. Unlike previous methods using complex engineered regularizers, our approach can suppress the noise well without additional regularization. Empirically, we show that our method consistently outperforms the state of the art on the largest available benchmarks on Text-based Zero-shot Learning.

📄 PDF Abstract BibTeX arXiv:1712.01381

Code (0)

등록된 구현이 없습니다.

Tasks

ArticlesZero-Shot Learning

Similar Papers 제목 키워드 기반

Generative Adversarial Zero-Shot Relational Learning for Knowledge Graphs

2020-01-08 · Pengda Qin, Xin Wang, Wenhu Chen, Chunyun Zhang 외

Large-scale knowledge graphs (KGs) are shown to become more important in current information systems. To expand the coverage of KGs, previous studies on knowledge graph completion need to collect adequate training instan…

Knowledge Graph CompletionKnowledge GraphsRelational ReasoningZero-Shot Learning

StarGAN-ZSVC: Towards Zero-Shot Voice Conversion in Low-Resource Contexts

2021-05-31 · Matthew Baas, Herman Kamper

Voice conversion is the task of converting a spoken utterance from a source speaker so that it appears to be said by a different target speaker while retaining the linguistic content of the utterance. Recent advances hav…

Voice Conversion

Finetune Like You Pretrain: Boosting Zero-shot Adversarial Robustness in Vision-language Models

2026-04-13 · Songlong Xing, Weijie Wang, Zhengyu Zhao, Jindong Gu 외 arxiv

Despite their impressive zero-shot abilities, vision-language models such as CLIP have been shown to be susceptible to adversarial attacks. To enhance its adversarial robustness, recent studies finetune the pretrained vi…

Adversarial Robustness

Concept-Guided Noisy Negative Suppression for Zero-Shot Classification and Grounding of Chest X-Ray Findings

2026-05-19 · Chenyu Lian, Hong-Yu Zhou, Chun-Ka Wong, Jing Qin arxiv

Vision-language alignment using chest X-rays and radiology reports has emerged as an advanced paradigm for zero-shot classification and grounding of chest X-ray findings. However, standard contrastive learning typically …

Contrastive Learning

Understanding Zero-Shot Adversarial Robustness for Large-Scale Models

2022-12-14 · Chengzhi Mao, Scott Geng, Junfeng Yang, Xin Wang 외

Pretrained large-scale vision-language models like CLIP have exhibited strong generalization over unseen tasks. Yet imperceptible adversarial perturbations can significantly reduce CLIP's performance on new tasks. In thi…

Adversarial RobustnessContrastive LearningVisual Prompt Tuning