paper-with-me

Papers

Zero-Shot Learning from scratch (ZFS): leveraging local compositional representations

2020-10-22 · Tristan Sylvain, Linda Petrini, R Devon Hjelm

Zero-shot classification is a generalization task where no instance from the target classes is seen during training. To allow for test-time transfer, each class is annotated with semantic information, commonly in the form of attributes or text descriptions. While classical zero-shot learning does not explicitly forbid using information from other datasets, the approaches that achieve the best absolute performance on image benchmarks rely on features extracted from encoders pretrained on Imagenet. This approach relies on hyper-optimized Imagenet-relevant parameters from the supervised classification setting, entangling important questions about the suitability of those parameters and how they were learned with more fundamental questions about representation learning and generalization. To remove these distractors, we propose a more challenging setting: Zero-Shot Learning from scratch (ZFS), which explicitly forbids the use of encoders fine-tuned on other datasets. Our analysis on this setting highlights the importance of local information, and compositional representations.

📄 PDF Abstract BibTeX arXiv:2010.13320

Code (0)

등록된 구현이 없습니다.

Tasks

General ClassificationRepresentation Learningzero-shot-classificationZero-Shot Learning

Similar Papers 제목 키워드 기반

Zero-Shot Policy Transfer with Disentangled Task Representation of Meta-Reinforcement Learning

2022-10-01 · Zheng Wu, Yichen Xie, Wenzhao Lian, Changhao Wang 외

Humans are capable of abstracting various tasks as different combinations of multiple attributes. This perspective of compositionality is vital for human rapid learning and adaption since previous experiences from relate…

DisentanglementMeta Reinforcement Learningreinforcement-learningReinforcement Learning (RL)

Locality and compositionality in zero-shot learning

2019-12-20 · ICLR 2020 1 · Tristan Sylvain, Linda Petrini, Devon Hjelm

In this work we study locality and compositionality in the context of learning representations for Zero Shot Learning (ZSL). In order to well-isolate the importance of these properties in learned representations, we impo…

Representation LearningZero-Shot Learning

A Deep Compositional Framework for Human-like Language Acquisition in Virtual Environment

2017-03-28 · Haonan Yu, Haichao Zhang, Wei Xu

We tackle a task where an agent learns to navigate in a 2D maze-like environment called XWORLD. In each session, the agent perceives a sequence of raw-pixel frames, a natural language command issued by a teacher, and a s…

Language AcquisitionNavigateZero-Shot Learning

MSCI: Addressing CLIP's Inherent Limitations for Compositional Zero-Shot Learning

2025-05-15 · Yue Wang, Shuai Xu, Xuelin Zhu, Yicong Li

Compositional Zero-Shot Learning (CZSL) aims to recognize unseen state-object combinations by leveraging known combinations. Existing studies basically rely on the cross-modal alignment capabilities of CLIP but tend to o…

Compositional Zero-Shot Learningcross-modal alignmentZero-Shot Learning

Independent Prototype Propagation for Zero-Shot Compositionality

2021-06-01 · NeurIPS 2021 12 · Frank Ruis, Gertjan Burghouts, Doina Bucur

Humans are good at compositional zero-shot reasoning; someone who has never seen a zebra before could nevertheless recognize one when we tell them it looks like a horse with black and white stripes. Machine learning syst…

AttributeCompositional Zero-Shot Learning