Weakly Supervised Recovery of Semantic Attributes
We consider the problem of the extraction of semantic attributes, supervised only with classification labels. For example, when learning to classify images of birds into species, we would like to observe the emergence of features that zoologists use to classify birds. To tackle this problem, we propose training a neural network with discrete features in the last layer, which is followed by two heads: a multi-layered perceptron (MLP) and a decision tree. Since decision trees utilize simple binary decision stumps we expect those discrete features to obtain semantic meaning. We present a theoretical analysis as well as a practical method for learning in the intersection of two hypothesis classes. Our results on multiple benchmarks show an improved ability to extract a set of features that are highly correlated with the set of unseen attributes.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Weakly Supervised Image Annotation and Segmentation with Objects and Attributes
We propose to model complex visual scenes using a non-parametric Bayesian model learned from weakly labelled images abundant on media sharing sites such as Flickr. Given weak image-level annotations of objects and attrib…
AttributeObjectobject-detectionObject Detection+3Weakly Supervised Learning of Mid-Level Features with Beta-Bernoulli Process Restricted Boltzmann Machines
The use of semantic attributes in computer vision problems has been gaining increased popularity in recent years. Attributes provide an intermediate feature representation in between low-level features and the class cate…
Object RecognitionWeakly-supervised LearningHarvesting Information from Captions for Weakly Supervised Semantic Segmentation
Since acquiring pixel-wise annotations for training convolutional neural networks for semantic image segmentation is time-consuming, weakly supervised approaches that only require class tags have been proposed. In this w…
Image CaptioningImage SegmentationSegmentationSemantic Segmentation+2Weakly Supervised Learning of Objects, Attributes and their Associations
When humans describe images they tend to use combinations of nouns and adjectives, corresponding to objects and their associated attributes respectively. To generate such a description automatically, one needs to model o…
AttributeImage DescriptionObjectRetrieval+1Through the Looking Glass: A Dual Perspective on Weakly-Supervised Few-Shot Segmentation
Meta-learning aims to uniformly sample homogeneous support-query pairs, characterized by the same categories and similar attributes, and extract useful inductive biases through identical network architectures. However, t…
Few-Shot Semantic Segmentation