Multi-Relational Classification via Bayesian Ranked Non-Linear Embeddings
The task of classifying multi-relational data spans a wide range of domains such as document classification in citation networks, classification of emails, and protein labeling in proteins interaction graphs. Current state-of-the-art classification models rely on learning per-entity latent representations by mining the whole structure of the relations' graph, however, they still face two major problems. Firstly, it is very challenging to generate expressive latent representations in sparse multi-relational settings with implicit feedback relations as there is very little information per-entity. Secondly, for entities with structured properties such as titles and abstracts (text) in documents, models have to be modified ad-hoc. In this paper, we aim to overcome these two main drawbacks by proposing a flexible nonlinear latent embedding model (BRNLE) for the classification of multi-relational data. The proposed model can be applied to entities with structured properties such as text by utilizing the numerical vector representations of those properties. To address the sparsity problem of implicit feedback relations, the model is optimized via a sparsely-regularized multi-relational pair-wise Bayesian personalized ranking loss (BPR). Experiments on four different real-world datasets show that the proposed model significantly outperforms state-of-the-art models for multi-relational classification.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationDocument ClassificationGeneral ClassificationHeterogeneous Node ClassificationLink PredictionNode ClassificationSimilar Papers 제목 키워드 기반
A Unified Representation Learning Strategy for Open Relation Extraction with Ranked List Loss
“Open Relation Extraction (OpenRE) aiming to extract relational facts from open-domain cor-pora is a sub-task of Relation Extraction and a crucial upstream process for many other NLPtasks. However various previous cluste…
ClusteringMetric LearningRelationRelation Extraction+1Macau: Scalable Bayesian Multi-relational Factorization with Side Information using MCMC
We propose Macau, a powerful and flexible Bayesian factorization method for heterogeneous data. Our model can factorize any set of entities and relations that can be represented by a relational model, including tensors a…
Activity PredictionRelationBreast Cancer Diagnosis via Classification Algorithms
In this paper, we analyze the Wisconsin Diagnostic Breast Cancer Data using Machine Learning classification techniques, such as the SVM, Bayesian Logistic Regression (Variational Approximation), and K-Nearest-Neighbors. …
BIG-bench Machine LearningClassificationDiagnosticGeneral Classification+1A Bayesian approach to multi-task learning with network lasso
Network lasso is a method for solving a multi-task learning problem through the regularized maximum likelihood method. A characteristic of network lasso is setting a different model for each sample. The relationships amo…
Multi-Task LearningConceptNet at SemEval-2017 Task 2: Extending Word Embeddings with Multilingual Relational Knowledge
This paper describes Luminoso's participation in SemEval 2017 Task 2, "Multilingual and Cross-lingual Semantic Word Similarity", with a system based on ConceptNet. ConceptNet is an open, multilingual knowledge graph that…
General KnowledgeMultilingual Word EmbeddingsTask 2Word Embeddings+1