HUGE: Huge Unsupervised Graph Embeddings with TPUs
Graphs are a representation of structured data that captures the relationships between sets of objects. With the ubiquity of available network data, there is increasing industrial and academic need to quickly analyze graphs with billions of nodes and trillions of edges. A common first step for network understanding is Graph Embedding, the process of creating a continuous representation of nodes in a graph. A continuous representation is often more amenable, especially at scale, for solving downstream machine learning tasks such as classification, link prediction, and clustering. A high-performance graph embedding architecture leveraging Tensor Processing Units (TPUs) with configurable amounts of high-bandwidth memory is presented that simplifies the graph embedding problem and can scale to graphs with billions of nodes and trillions of edges. We verify the embedding space quality on real and synthetic large-scale datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Graph EmbeddingLink PredictionSimilar Papers 제목 키워드 기반
Maximizing Parallelism in Distributed Training for Huge Neural Networks
The recent Natural Language Processing techniques have been refreshing the state-of-the-art performance at an incredible speed. Training huge language models is therefore an imperative demand in both industry and academy…
Learning Universal Graph Neural Network Embeddings With Aid Of Transfer Learning
Learning powerful data embeddings has become a center piece in machine learning, especially in natural language processing and computer vision domains. The crux of these embeddings is that they are pretrained on huge cor…
DecoderGraph ClassificationGraph EmbeddingGraph Learning+2A Label-Free Heterophily-Guided Approach for Unsupervised Graph Fraud Detection
Graph fraud detection (GFD) has rapidly advanced in protecting online services by identifying malicious fraudsters. Recent supervised GFD research highlights that heterophilic connections between fraudsters and users can…
Fraud DetectionMerlin HugeCTR: GPU-accelerated Recommender System Training and Inference
In this talk, we introduce Merlin HugeCTR. Merlin HugeCTR is an open source, GPU-accelerated integration framework for click-through rate estimation. It optimizes both training and inference, whilst enabling model traini…
CPUGPURecommendation SystemsRetrievalScalable Feature Learning on Huge Knowledge Graphs for Downstream Machine Learning
Many machine learning tasks can benefit from external knowledge. Large knowledge graphs store such knowledge, and embedding methods can be used to distill it into ready-to-use vector representations for downstream applic…
Contrastive LearningKnowledge GraphsLink Prediction