Analogical Inference for Multi-Relational Embeddings
Large-scale multi-relational embedding refers to the task of learning the latent representations for entities and relations in large knowledge graphs. An effective and scalable solution for this problem is crucial for the true success of knowledge-based inference in a broad range of applications. This paper proposes a novel framework for optimizing the latent representations with respect to the \textit{analogical} properties of the embedded entities and relations. By formulating the learning objective in a differentiable fashion, our model enjoys both theoretical power and computational scalability, and significantly outperformed a large number of representative baseline methods on benchmark datasets. Furthermore, the model offers an elegant unification of several well-known methods in multi-relational embedding, which can be proven to be special instantiations of our framework.
Code (1)
Tasks
Knowledge GraphsLink PredictionSimilar Papers 제목 키워드 기반
Analogy as Nonparametric Bayesian Inference over Relational Systems
Much of human learning and inference can be framed within the computational problem of relational generalization. In this project, we propose a Bayesian model that generalizes relational knowledge to novel environments b…
Analogical SimilarityBayesian InferenceEmergent Analogical Reasoning in Transformers
Analogy is a central faculty of human intelligence, enabling abstract patterns discovered in one domain to be applied to another. Despite its central role in cognition, the mechanisms by which Transformers acquire and im…
Learning Analogy-Preserving Sentence Embeddings for Answer Selection
Answer selection aims at identifying the correct answer for a given question from a set of potentially correct answers. Contrary to previous works, which typically focus on the semantic similarity between a question and …
Answer SelectionQuestion AnsweringSemantic SimilaritySemantic Textual Similarity+2A Theory of Relation Learning and Cross-domain Generalization
People readily generalize knowledge to novel domains and stimuli. We present a theory, instantiated in a computational model, based on the idea that cross-domain generalization in humans is a case of analogical inference…
BIG-bench Machine LearningDomain GeneralizationRelationZero-Shot LearningReinforcement Learning with Analogical Similarity to Guide Schema Induction and Attention
Research in analogical reasoning suggests that higher-order cognitive functions such as abstract reasoning, far transfer, and creativity are founded on recognizing structural similarities among relational systems. Here w…
Analogical Similarityreinforcement-learningReinforcement LearningReinforcement Learning (RL)