paper-with-me

홈 › Papers

Network Embedding: on Compression and Learning

2019-07-05 · Esra Akbas, Mehmet Aktas

Recently, network embedding that encodes structural information of graphs into a vector space has become popular for network analysis. Although recent methods show promising performance for various applications, the huge sizes of graphs may hinder a direct application of existing network embedding method to them. This paper presents NECL, a novel efficient Network Embedding method with two goals. 1) Is there an ideal Compression of a network? 2) Will the compression of a network significantly boost the representation Learning of the network? For the first problem, we propose a neighborhood similarity based graph compression method that compresses the input graph to get a smaller graph without losing any/much information about the global structure of the graph and the local proximity of the vertices in the graph. For the second problem, we use the compressed graph for network embedding instead of the original large graph to bring down the embedding cost. NECL is a general meta-strategy to improve the efficiency of all of the state-of-the-art graph embedding algorithms based on random walks, including DeepWalk and Node2vec, without losing their effectiveness. Extensive experiments on large real-world networks validate the efficiency of NECL method that yields an average improvement of 23 - 57% embedding time, including walking and learning time without decreasing classification accuracy as evaluated on single and multi-label classification tasks on real-world graphs such as DBLP, BlogCatalog, Cora and Wiki.

📄 PDF Abstract BibTeX arXiv:1907.02811

Code (1)

esraabil/NECL

Tasks

Graph EmbeddingMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONNetwork EmbeddingRepresentation Learning

Methods 이 논문이 사용한 방법론

DeepWalk DeepWalk learns embeddings (social representations) of a graph's vertices, by modeling a stream of short random walks. Social representations are latent features of the…

Similar Papers 제목 키워드 기반

Neural Embedding Compression For Efficient Multi-Task Earth Observation Modelling

2024-03-26 · Carlos Gomes, Thomas Brunschwiler

As repositories of large scale data in earth observation (EO) have grown, so have transfer and storage costs for model training and inference, expending significant resources. We introduce Neural Embedding Compression (N…

Earth ObservationScene ClassificationSemantic Segmentation

Embedding Compression with Hashing for Efficient Representation Learning in Graph

2021-09-29 · Chin-Chia Michael Yeh, Mengting Gu, Yan Zheng, Huiyuan Chen 외

Graph neural networks (GNNs) are deep learning models designed specifically for graph data, and they typically rely on node features as the input node representation to the first layer. When applying such type of network…

GPURepresentation Learning

Embedding Compression with Hashing for Efficient Representation Learning in Large-Scale Graph

2022-08-11 · Chin-Chia Michael Yeh, Mengting Gu, Yan Zheng, Huiyuan Chen 외

Graph neural networks (GNNs) are deep learning models designed specifically for graph data, and they typically rely on node features as the input to the first layer. When applying such a type of network on the graph with…

GPURepresentation Learning

Embedding Compression for Teacher-to-Student Knowledge Transfer

2024-02-09 · Yiwei Ding, Alexander Lerch

Common knowledge distillation methods require the teacher model and the student model to be trained on the same task. However, the usage of embeddings as teachers has also been proposed for different source tasks and tar…

Knowledge DistillationTransfer Learning

Sentence Compression as Deletion with Contextual Embeddings

2020-06-05 · Minh-Tien Nguyen, Bui Cong Minh, Dung Tien Le, Le Thai Linh

Sentence compression is the task of creating a shorter version of an input sentence while keeping important information. In this paper, we extend the task of compression by deletion with the use of contextual embeddings.…

SentenceSentence Compression