Boosting Graph Embedding on a Single GPU
Graphs are ubiquitous, and they can model unique characteristics and complex relations of real-life systems. Although using machine learning (ML) on graphs is promising, their raw representation is not suitable for ML algorithms. Graph embedding represents each node of a graph as a d-dimensional vector which is more suitable for ML tasks. However, the embedding process is expensive, and CPU-based tools do not scale to real-world graphs. In this work, we present GOSH, a GPU-based tool for embedding large-scale graphs with minimum hardware constraints. GOSH employs a novel graph coarsening algorithm to enhance the impact of updates and minimize the work for embedding. It also incorporates a decomposition schema that enables any arbitrarily large graph to be embedded with a single GPU. As a result, GOSH sets a new state-of-the-art in link prediction both in accuracy and speed, and delivers high-quality embeddings for node classification at a fraction of the time compared to the state-of-the-art. For instance, it can embed a graph with over 65 million vertices and 1.8 billion edges in less than 30 minutes on a single GPU.
Code (1)
Tasks
CPUGPUGraph EmbeddingLink PredictionNode ClassificationSimilar Papers 제목 키워드 기반
AdaGNN: A multi-modal latent representation meta-learner for GNNs based on AdaBoosting
As a special field in deep learning, Graph Neural Networks (GNNs) focus on extracting intrinsic network features and have drawn unprecedented popularity in both academia and industry. Most of the state-of-the-art GNN mod…
DecoderRecommendation SystemsClose, But Not There: Boosting Geographic Distance Sensitivity in Visual Place Recognition
Visual Place Recognition (VPR) plays a critical role in many localization and mapping pipelines. It consists of retrieving the closest sample to a query image, in a certain embedding space, from a database of geotagged r…
SensitivityVisual Place RecognitionMultiple Run Ensemble Learning with Low-Dimensional Knowledge Graph Embeddings
Among the top approaches of recent years, link prediction using knowledge graph embedding (KGE) models has gained significant attention for knowledge graph completion. Various embedding models have been proposed so far, …
Ensemble LearningGraph EmbeddingKnowledge Graph CompletionKnowledge Graph Embedding+2Boosting Code Summarization by Embedding Code Structures
Recent research on code summarization relies on the structural information from the abstract syntax tree (AST) of source codes. It is, however, questionable whether it is the most effective to use AST for expressing the …
Code SummarizationGraph EmbeddingMulti-Level Network Embedding with Boosted Low-Rank Matrix Approximation
As opposed to manual feature engineering which is tedious and difficult to scale, network representation learning has attracted a surge of research interests as it automates the process of feature learning on graphs. The…
Ensemble LearningFeature EngineeringNetwork EmbeddingRepresentation Learning