Discriminative Transfer Learning with Tree-based Priors
This paper proposes a way of improving classification performance for classes which have very few training examples. The key idea is to discover classes which are similar and transfer knowledge among them. Our method organizes the classes into a tree hierarchy. The tree structure can be used to impose a generative prior over classification parameters. We show that these priors can be combined with discriminative models such as deep neural networks. Our method benefits from the power of discriminative training of deep neural networks, at the same time using tree-based generative priors over classification parameters. We also propose an algorithm for learning the underlying tree structure. This gives the model some flexibility to tune the tree so that the tree is pertinent to task being solved. We show that the model can transfer knowledge across related classes using fixed semantic trees. Moreover, it can learn new meaningful trees usually leading to improved performance. Our method achieves state-of-the-art classification results on the CIFAR-100 image data set and the MIR Flickr multimodal data set.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationGeneral ClassificationImage ClassificationTransfer LearningSimilar Papers 제목 키워드 기반
Few-Shot Airway-Tree Modeling using Data-Driven Sparse Priors
The lack of large annotated datasets in medical imaging is an intrinsic burden for supervised Deep Learning (DL) segmentation models. Few-shot learning approaches are cost-effective solutions to transfer pre-trained mode…
DiversityFew-Shot LearningSegmentationDiscriminative Transfer Learning for General Image Restoration
Recently, several discriminative learning approaches have been proposed for effective image restoration, achieving convincing trade-off between image quality and computational efficiency. However, these methods require s…
Computational EfficiencyDeblurringDemosaickingDenoising+2Granularity-Aware Transfer for Tree Instance Segmentation in Synthetic and Real Forests
We address the challenge of synthetic-to-real transfer in forestry perception where real data have only coarse Tree labels while synthetic data provide fine-grained trunk/crown annotations. We introduce MGTD, a mixed-gra…
Instance SegmentationAdvances in Using Grammars with Latent Annotations for Discontinuous Parsing
We present new experiments that transfer techniques from Probabilistic Context-free Grammars with Latent Annotations (PCFG-LA) to two grammar formalisms for discontinuous parsing: linear context-free rewriting systems an…
Crowd Counting by Self-supervised Transfer Colorization Learning and Global Prior Classification
Labeled crowd scene images are expensive and scarce. To significantly reduce the requirement of the labeled images, we propose ColorCount, a novel CNN-based approach by combining self-supervised transfer colorization lea…
ColorizationCrowd Counting