paper-with-me

홈 › Papers

Billion-scale Network Embedding with Iterative Random Projection

2018-05-07 · Ziwei Zhang, Peng Cui, Haoyang Li, Xiao Wang, Wenwu Zhu

Network embedding, which learns low-dimensional vector representation for nodes in the network, has attracted considerable research attention recently. However, the existing methods are incapable of handling billion-scale networks, because they are computationally expensive and, at the same time, difficult to be accelerated by distributed computing schemes. To address these problems, we propose RandNE (Iterative Random Projection Network Embedding), a novel and simple billion-scale network embedding method. Specifically, we propose a Gaussian random projection approach to map the network into a low-dimensional embedding space while preserving the high-order proximities between nodes. To reduce the time complexity, we design an iterative projection procedure to avoid the explicit calculation of the high-order proximities. Theoretical analysis shows that our method is extremely efficient, and friendly to distributed computing schemes without any communication cost in the calculation. We also design a dynamic updating procedure which can efficiently incorporate the dynamic changes of the networks without error aggregation. Extensive experimental results demonstrate the efficiency and efficacy of RandNE over state-of-the-art methods in several tasks including network reconstruction, link prediction and node classification on multiple datasets with different scales, ranging from thousands to billions of nodes and edges.

📄 PDF Abstract BibTeX arXiv:1805.02396

Code (2)

ZW-ZHANG/RandNE 공식 구현
benedekrozemberczki/karateclub

Tasks

Distributed ComputingLink PredictionNetwork EmbeddingNode Classification

Similar Papers 제목 키워드 기반

Better Hit the Nail on the Head than Beat around the Bush: Removing Protected Attributes with a Single Projection

2022-12-08 · Pantea Haghighatkhah, Antske Fokkens, Pia Sommerauer, Bettina Speckmann 외

Bias elimination and recent probing studies attempt to remove specific information from embedding spaces. Here it is important to remove as much of the target information as possible, while preserving any other informati…

Distributed Graph Embedding with Information-Oriented Random Walks

2023-03-28 · Peng Fang, Arijit Khan, Siqiang Luo, Fang Wang 외

Graph embedding maps graph nodes to low-dimensional vectors, and is widely adopted in machine learning tasks. The increasing availability of billion-edge graphs underscores the importance of learning efficient and effect…

CPUGraph Embeddinggraph partitioningLink Prediction

Graph Convolutional Neural Networks for Web-Scale Recommender Systems

2018-06-06 · Rex Ying, Ruining He, Kai-Feng Chen, Pong Eksombatchai 외

Recent advancements in deep neural networks for graph-structured data have led to state-of-the-art performance on recommender system benchmarks. However, making these methods practical and scalable to web-scale recommend…

Recommendation Systems

Large-scale optimal transport map estimation using projection pursuit

2021-06-09 · NeurIPS 2019 12 · Cheng Meng, Yuan Ke, Jingyi Zhang, Mengrui Zhang 외

This paper studies the estimation of large-scale optimal transport maps (OTM), which is a well-known challenging problem owing to the curse of dimensionality. Existing literature approximates the large-scale OTM by a ser…

Dimensionality Reduction

Sketching Meets Random Projection in the Dual: A Provable Recovery Algorithm for Big and High-dimensional Data

2016-10-10 · Jialei Wang, Jason D. Lee, Mehrdad Mahdavi, Mladen Kolar 외

Sketching techniques have become popular for scaling up machine learning algorithms by reducing the sample size or dimensionality of massive data sets, while still maintaining the statistical power of big data. In this p…