SnapE -- Training Snapshot Ensembles of Link Prediction Models
Snapshot ensembles have been widely used in various fields of prediction. They allow for training an ensemble of prediction models at the cost of training a single one. They are known to yield more robust predictions by creating a set of diverse base models. In this paper, we introduce an approach to transfer the idea of snapshot ensembles to link prediction models in knowledge graphs. Moreover, since link prediction in knowledge graphs is a setup without explicit negative examples, we propose a novel training loop that iteratively creates negative examples using previous snapshot models. An evaluation with four base models across four datasets shows that this approach constantly outperforms the single model approach, while keeping the training time constant.
Code (0)
등록된 구현이 없습니다.
Tasks
Knowledge GraphsLink PredictionPredictionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Snapshot Ensembles: Train 1, get M for free
Ensembles of neural networks are known to be much more robust and accurate than individual networks. However, training multiple deep networks for model averaging is computationally expensive. In this paper, we propose a …
MotherNets: Rapid Deep Ensemble Learning
Ensembles of deep neural networks significantly improve generalization accuracy. However, training neural network ensembles requires a large amount of computational resources and time. State-of-the-art approaches either …
ClusteringClustering EnsembleEnsemble LearningKnowledge DistillationData-Driven Theory-guided Learning of Partial Differential Equations using SimultaNeous Basis Function Approximation and Parameter Estimation (SNAPE)
The measured spatiotemporal response of various physical processes is utilized to infer the governing partial differential equations (PDEs). We propose SimultaNeous Basis Function Approximation and Parameter Estimation (…
parameter estimationDeep Confidence: A Computationally Efficient Framework for Calculating Reliable Errors for Deep Neural Networks
Deep learning architectures have proved versatile in a number of drug discovery applications, including the modelling of in vitro compound activity. While controlling for prediction confidence is essential to increase th…
Conformal PredictionDeep LearningDrug DiscoveryPredictionEffective training-time stacking for ensembling of deep neural networks
Ensembling is a popular and effective method for improving machine learning (ML) models. It proves its value not only in classical ML but also for deep learning. Ensembles enhance the quality and trustworthiness of ML so…
Deep Learning