Exploring representation learning for flexible few-shot tasks
Existing approaches to few-shot learning deal with tasks that have persistent, rigid notions of classes. Typically, the learner observes data only from a fixed number of classes at training time and is asked to generalize to a new set of classes at test time. Two examples from the same class would always be assigned the same labels in any episode. In this work, we consider a realistic setting where the relationship between examples can change from episode to episode depending on the task context, which is not given to the learner. We define two new benchmark datasets for this flexible few-shot scenario, where the tasks are based on images of faces (Celeb-A) and shoes (Zappos50K). While classification baselines learn representations that work well for standard few-shot learning, they suffer in our flexible tasks since the classification criteria shift from training to testing. On the other hand, unsupervised contrastive representation learning with instance-based invariance objectives preserves such flexibility. A combination of instance and class invariance learning objectives is found to perform best on our new flexible few-shot learning benchmarks, and a novel variant of Prototypical Networks is proposed for selecting useful feature dimensions.
Code (0)
등록된 구현이 없습니다.
Tasks
Few-Shot LearningRepresentation LearningSimilar Papers 제목 키워드 기반
ScaleNAS: One-Shot Learning of Scale-Aware Representations for Visual Recognition
Scale variance among different sizes of body parts and objects is a challenging problem for visual recognition tasks. Existing works usually design dedicated backbone or apply Neural architecture Search(NAS) for each tas…
Multi-Person Pose EstimationNeural Architecture SearchOne-Shot LearningPose Estimation+1Defining Benchmarks for Continual Few-Shot Learning
Both few-shot and continual learning have seen substantial progress in the last years due to the introduction of proper benchmarks. That being said, the field has still to frame a suite of benchmarks for the highly desir…
continual few-shot learningContinual LearningFew-Shot LearningExploring Scalable Unified Modeling for General Low-Level Vision
Low-level vision involves a wide spectrum of tasks, including image restoration, enhancement, stylization, and feature extraction, which differ significantly in both task formulation and output domains. To address the ch…
Zero-shot GeneralizationImage RestorationExploring Task Difficulty for Few-Shot Relation Extraction
Few-shot relation extraction (FSRE) focuses on recognizing novel relations by learning with merely a handful of annotated instances. Meta-learning has been widely adopted for such a task, which trains on randomly generat…
Contrastive LearningMeta-LearningRelationRelation ExtractionUni3D: Exploring Unified 3D Representation at Scale
Scaling up representations for images or text has been extensively investigated in the past few years and has led to revolutions in learning vision and language. However, scalable representation for 3D objects and scenes…
3D Object ClassificationRetrievalZero-shot 3D classificationZero-shot 3D Point Cloud Classification+4