paper-with-me

홈 › Papers

Few-shot Learning by Exploiting Visual Concepts within CNNs

2017-11-22 · Boyang Deng, Qing Liu, Siyuan Qiao, Alan Yuille

Convolutional neural networks (CNNs) are one of the driving forces for the advancement of computer vision. Despite their promising performances on many tasks, CNNs still face major obstacles on the road to achieving ideal machine intelligence. One is that CNNs are complex and hard to interpret. Another is that standard CNNs require large amounts of annotated data, which is sometimes hard to obtain, and it is desirable to learn to recognize objects from few examples. In this work, we address these limitations of CNNs by developing novel, flexible, and interpretable models for few-shot learning. Our models are based on the idea of encoding objects in terms of visual concepts (VCs), which are interpretable visual cues represented by the feature vectors within CNNs. We first adapt the learning of VCs to the few-shot setting, and then uncover two key properties of feature encoding using VCs, which we call category sensitivity and spatial pattern. Motivated by these properties, we present two intuitive models for the problem of few-shot learning. Experiments show that our models achieve competitive performances, while being more flexible and interpretable than alternative state-of-the-art few-shot learning methods. We conclude that using VCs helps expose the natural capability of CNNs for few-shot learning.

📄 PDF Abstract BibTeX arXiv:1711.08277

Code (0)

등록된 구현이 없습니다.

Tasks

Few-Shot Learning

Similar Papers 제목 키워드 기반

Unleashing the Potential of CNNs for Interpretable Few-Shot Learning

2018-01-01 · ICLR 2018 1 · Boyang Deng, Qing Liu, Siyuan Qiao, Alan Yuille

Convolutional neural networks (CNNs) have been generally acknowledged as one of the driving forces for the advancement of computer vision. Despite their promising performances on many tasks, CNNs still face major obstacl…

Few-Shot Learning

Interactive Acquisition of Fine-grained Visual Concepts by Exploiting Semantics of Generic Characterizations in Discourse

2023-05-05 · Jonghyuk Park, Alex Lascarides, Subramanian Ramamoorthy

Interactive Task Learning (ITL) concerns learning about unforeseen domain concepts via natural interactions with human users. The learner faces a number of significant constraints: learning should be online, incremental …

AttributeImplicatures

Task-Aware Feature Generation for Zero-Shot Compositional Learning

2019-06-11 · Xin Wang, Fisher Yu, Trevor Darrell, Joseph E. Gonzalez

Visual concepts (e.g., red apple, big elephant) are often semantically compositional and each element of the compositions can be reused to construct novel concepts (e.g., red elephant). Compositional feature synthesis, w…

Novel ConceptsZero-Shot Learning

A Simple Framework for Open-Vocabulary Zero-Shot Segmentation

2024-06-23 · Thomas Stegmüller, Tim Lebailly, Nikola Dukic, Behzad Bozorgtabar 외

Zero-shot classification capabilities naturally arise in models trained within a vision-language contrastive framework. Despite their classification prowess, these models struggle in dense tasks like zero-shot open-vocab…

Representation Learningzero-shot-classificationZero-Shot LearningZero Shot Segmentation

A Convolution Tree with Deconvolution Branches: Exploiting Geometric Relationships for Single Shot Keypoint Detection

2017-04-06 · Amit Kumar, Rama Chellappa

Recently, Deep Convolution Networks (DCNNs) have been applied to the task of face alignment and have shown potential for learning improved feature representations. Although deeper layers can capture abstract concepts lik…

Face AlignmentKeypoint Detection