paper-with-me

홈 › Papers

Exploring representation learning for flexible few-shot tasks

2021-01-01 · Mengye Ren, Eleni Triantafillou, Kuan-Chieh Wang, James Lucas, Jake Snell, Xaq Pitkow, Andreas S. Tolias, Richard Zemel

Existing approaches to few-shot learning deal with tasks that have persistent, rigid notions of classes. Typically, the learner observes data only from a fixed number of classes at training time and is asked to generalize to a new set of classes at test time. Two examples from the same class would always be assigned the same labels in any episode. In this work, we consider a realistic setting where the relationship between examples can change from episode to episode depending on the task context, which is not given to the learner. We define two new benchmark datasets for this flexible few-shot scenario, where the tasks are based on images of faces (Celeb-A) and shoes (Zappos50K). While classification baselines learn representations that work well for standard few-shot learning, they suffer in our flexible tasks since the classification criteria shift from training to testing. On the other hand, unsupervised contrastive representation learning with instance-based invariance objectives preserves such flexibility. A combination of instance and class invariance learning objectives is found to perform best on our new flexible few-shot learning benchmarks, and a novel variant of Prototypical Networks is proposed for selecting useful feature dimensions.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Few-Shot LearningRepresentation Learning

Similar Papers 제목 키워드 기반

ScaleNAS: One-Shot Learning of Scale-Aware Representations for Visual Recognition

2020-11-30 · Hsin-Pai Cheng, Feng Liang, Meng Li, Bowen Cheng 외

Scale variance among different sizes of body parts and objects is a challenging problem for visual recognition tasks. Existing works usually design dedicated backbone or apply Neural architecture Search(NAS) for each tas…

Multi-Person Pose EstimationNeural Architecture SearchOne-Shot LearningPose Estimation+1

Defining Benchmarks for Continual Few-Shot Learning

2020-04-15 · Antreas Antoniou, Massimiliano Patacchiola, Mateusz Ochal, Amos Storkey

Both few-shot and continual learning have seen substantial progress in the last years due to the introduction of proper benchmarks. That being said, the field has still to frame a suite of benchmarks for the highly desir…

continual few-shot learningContinual LearningFew-Shot Learning

Exploring Scalable Unified Modeling for General Low-Level Vision

2025-07-20 · Xiangyu Chen, Kaiwen Zhu, Yuandong Pu, Shuo Cao 외 arxiv

Low-level vision involves a wide spectrum of tasks, including image restoration, enhancement, stylization, and feature extraction, which differ significantly in both task formulation and output domains. To address the ch…

Zero-shot GeneralizationImage Restoration

Exploring Task Difficulty for Few-Shot Relation Extraction

2021-09-12 · EMNLP 2021 11 · Jiale Han, Bo Cheng, Wei Lu

Few-shot relation extraction (FSRE) focuses on recognizing novel relations by learning with merely a handful of annotated instances. Meta-learning has been widely adopted for such a task, which trains on randomly generat…

Contrastive LearningMeta-LearningRelationRelation Extraction

Uni3D: Exploring Unified 3D Representation at Scale

2023-10-10 · Junsheng Zhou, Jinsheng Wang, Baorui Ma, Yu-Shen Liu 외

Scaling up representations for images or text has been extensively investigated in the past few years and has led to revolutions in learning vision and language. However, scalable representation for 3D objects and scenes…

3D Object ClassificationRetrievalZero-shot 3D classificationZero-shot 3D Point Cloud Classification+4