Probabilistic Semantic Embedding
We present an extension of a variational auto-encoder that creates semantically richcoupled probabilistic latent representations that capture the semantics of multiplemodalities of data. We demonstrate this model through experiments using imagesand textual descriptors as inputs and images as outputs. Our latent representationsare not only capable of driving a decoder to generate novel data, but can also be useddirectly for annotation or classification. Using the MNIST and Fashion-MNISTdatasets we show that the embedding not only provides better reconstruction andclassification performance than the current state-of-the-art, but it also allows us toexploit the semantic content of the pretrained word embedding spaces to do taskssuch as image generation from labels outside of those seen during training.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderGeneral ClassificationImage GenerationSimilar Papers 제목 키워드 기반
Unsupervised Knowledge Graph Alignment by Probabilistic Reasoning and Semantic Embedding
Knowledge Graph (KG) alignment is to discover the mappings (i.e., equivalent entities, relations, and others) between two KGs. The existing methods can be divided into the embedding-based models, and the conventional rea…
Interpretable probabilistic embeddings: bridging the gap between topic models and neural networks
We consider probabilistic topic models and more recent word embedding techniques from a perspective of learning hidden semantic representations. Inspired by a striking similarity of the two approaches, we merge them and …
Topic ModelsWord SimilarityProbabilistic Box Embeddings for Uncertain Knowledge Graph Reasoning
Knowledge bases often consist of facts which are harvested from a variety of sources, many of which are noisy and some of which conflict, resulting in a level of uncertainty for each triple. Knowledge bases are also ofte…
Graph EmbeddingKnowledge Graph EmbeddingPRASEMap: A Probabilistic Reasoning and Semantic Embedding based Knowledge Graph Alignment System
Knowledge Graph (KG) alignment aims at finding equivalent entities and relations (i.e., mappings) between two KGs. The existing approaches utilize either reasoning-based or semantic embedding-based techniques, but few st…
Domain Generalization with Small Data
In this work, we propose to tackle the problem of domain generalization in the context of \textit{insufficient samples}. Instead of extracting latent feature embeddings based on deterministic models, we propose to learn …
Domain Generalization