Learning to Learn with Compound HD Models
We introduce HD (or ``Hierarchical-Deep'') models, a new compositional learning architecture that integrates deep learning models with structured hierarchical Bayesian models. Specifically we show how we can learn a hierarchical Dirichlet process (HDP) prior over the activities of the top-level features in a Deep Boltzmann Machine (DBM). This compound HDP-DBM model learns to learn novel concepts from very few training examples, by learning low-level generic features, high-level features that capture correlations among low-level features, and a category hierarchy for sharing priors over the high-level features that are typical of different kinds of concepts. We present efficient learning and inference algorithms for the HDP-DBM model and show that it is able to learn new concepts from very few examples on CIFAR-100 object recognition, handwritten character recognition, and human motion capture datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Novel ConceptsObject RecognitionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
CompoundPiece: Evaluating and Improving Decompounding Performance of Language Models
While many languages possess processes of joining two or more words to create compound words, previous studies have been typically limited only to languages with excessively productive compound formation (e.g., German, D…
A Joint Approach to Compound Splitting and Idiomatic Compound Detection
Applications such as machine translation, speech recognition, and information retrieval require efficient handling of noun compounds as they are one of the possible sources for out-of-vocabulary (OOV) words. In-depth pro…
Information RetrievalMachine TranslationRetrievalspeech-recognition+2Target-Free Compound Activity Prediction via Few-Shot Learning
Predicting the activities of compounds against protein-based or phenotypic assays using only a few known compounds and their activities is a common task in target-free drug discovery. Existing few-shot learning approache…
Activity PredictionDrug DiscoveryFew-Shot LearningPredictionThe Development of Dutch and Afrikaans Language Resources for Compound Boundary Analysis.
In most languages, new words can be created through the process of compounding, which combines two or more words into a new lexical unit. Whereas in languages such as English the components that make up a compound are se…
Boundary DetectionCompoundE: Knowledge Graph Embedding with Translation, Rotation and Scaling Compound Operations
Translation, rotation, and scaling are three commonly used geometric manipulation operations in image processing. Besides, some of them are successfully used in developing effective knowledge graph embedding (KGE) models…
Graph EmbeddingKnowledge Graph EmbeddingRelationTranslation