paper-with-me

Papers

SnapE -- Training Snapshot Ensembles of Link Prediction Models

2024-08-05 · Ali Shaban, Heiko Paulheim

Snapshot ensembles have been widely used in various fields of prediction. They allow for training an ensemble of prediction models at the cost of training a single one. They are known to yield more robust predictions by creating a set of diverse base models. In this paper, we introduce an approach to transfer the idea of snapshot ensembles to link prediction models in knowledge graphs. Moreover, since link prediction in knowledge graphs is a setup without explicit negative examples, we propose a novel training loop that iteratively creates negative examples using previous snapshot models. An evaluation with four base models across four datasets shows that this approach constantly outperforms the single model approach, while keeping the training time constant.

📄 PDF Abstract BibTeX arXiv:2408.02707

Code (0)

등록된 구현이 없습니다.

Tasks

Knowledge GraphsLink PredictionPrediction

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Snapshot Ensembles The overhead cost of training multiple deep neural networks could be very high in terms of the training time, hardware, and computational resource requirement and…
BASE 설명 없음

Similar Papers 제목 키워드 기반

Snapshot Ensembles: Train 1, get M for free

2017-04-01 · Gao Huang, Yixuan Li, Geoff Pleiss, Zhuang Liu 외

Ensembles of neural networks are known to be much more robust and accurate than individual networks. However, training multiple deep networks for model averaging is computationally expensive. In this paper, we propose a …

MotherNets: Rapid Deep Ensemble Learning

2018-09-12 · Abdul Wasay, Brian Hentschel, Yuze Liao, Sanyuan Chen 외

Ensembles of deep neural networks significantly improve generalization accuracy. However, training neural network ensembles requires a large amount of computational resources and time. State-of-the-art approaches either …

ClusteringClustering EnsembleEnsemble LearningKnowledge Distillation

Data-Driven Theory-guided Learning of Partial Differential Equations using SimultaNeous Basis Function Approximation and Parameter Estimation (SNAPE)

2021-09-14 · Sutanu Bhowmick, Satish Nagarajaiah

The measured spatiotemporal response of various physical processes is utilized to infer the governing partial differential equations (PDEs). We propose SimultaNeous Basis Function Approximation and Parameter Estimation (…

parameter estimation

Deep Confidence: A Computationally Efficient Framework for Calculating Reliable Errors for Deep Neural Networks

2018-09-24 · Isidro Cortes-Ciriano, Andreas Bender

Deep learning architectures have proved versatile in a number of drug discovery applications, including the modelling of in vitro compound activity. While controlling for prediction confidence is essential to increase th…

Conformal PredictionDeep LearningDrug DiscoveryPrediction

Effective training-time stacking for ensembling of deep neural networks

2022-06-27 · Polina Proscura, Alexey Zaytsev

Ensembling is a popular and effective method for improving machine learning (ML) models. It proves its value not only in classical ML but also for deep learning. Ensembles enhance the quality and trustworthiness of ML so…

Deep Learning