BESS: Balanced Entity Sampling and Sharing for Large-Scale Knowledge Graph Completion
We present the award-winning submission to the WikiKG90Mv2 track of OGB-LSC@NeurIPS 2022. The task is link-prediction on the large-scale knowledge graph WikiKG90Mv2, consisting of 90M+ nodes and 600M+ edges. Our solution uses a diverse ensemble of $85$ Knowledge Graph Embedding models combining five different scoring functions (TransE, TransH, RotatE, DistMult, ComplEx) and two different loss functions (log-sigmoid, sampled softmax cross-entropy). Each individual model is trained in parallel on a Graphcore Bow Pod$_{16}$ using BESS (Balanced Entity Sampling and Sharing), a new distribution framework for KGE training and inference based on balanced collective communications between workers. Our final model achieves a validation MRR of 0.2922 and a test-challenge MRR of 0.2562, winning the first place in the competition. The code is publicly available at: https://github.com/graphcore/distributed-kge-poplar/tree/2022-ogb-submission.
Code (2)
Tasks
Graph EmbeddingKnowledge Graph CompletionKnowledge Graph EmbeddingLink PredictionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Optimal Power Management for Large-Scale Battery Energy Storage Systems via Bayesian Inference
Large-scale battery energy storage systems (BESS) have found ever-increasing use across industry and society to accelerate clean energy transition and improve energy supply reliability and resilience. However, their opti…
Bayesian InferenceManagementModel Predictive Controlparameter estimationPhysics-Aware Heterogeneous GNN Architecture for Real-Time BESS Optimization in Unbalanced Distribution Systems
Battery energy storage systems (BESS) have become increasingly vital in three-phase unbalanced distribution grids for maintaining voltage stability and enabling optimal dispatch. However, existing deep learning approache…
Efficient 3D affinely equivariant CNNs with adaptive fusion of augmented spherical Fourier-Bessel bases
Filter-decomposition-based group equivariant convolutional neural networks (CNNs) have shown promising stability and data efficiency for 3D image feature extraction. However, these networks, which rely on parameter shari…
Image SegmentationMedical Image SegmentationOrgan SegmentationSegmentation+1Optimization and Characterization of Near-Field Beams with Uniform Linear Arrays
In this paper, we consider near-field beams that can mitigate signal attenuation and blockage effects using a uniform linear array (ULA). In particular, closed-form expressions for phase distributions in a ULA are derive…
Guaranteeing Service in Connected Microgrids: Storage Planning and Optimal Power Sharing Policy
The integration of renewable energy sources (RES) into power distribution grids poses challenges to system reliability due to the inherent uncertainty in their power production. To address this issue, battery energy sour…