paper-with-me

Papers

Binarized Attributed Network Embedding

2018-10-22 · ICDM 2018 10 · Hong Yang, Shirui Pan, Peng Zhang, Ling Chen, Defu Lian, Chengqi Zhang

An implementation of "Binarized Attributed Network Embedding". Attributed network embedding enables joint representation learning of node links and attributes. Existing attributed network embedding models are designed in continuous Euclidean spaces which often introduce data redundancy and impose challenges to storage and computation costs. To this end, we present a Binarized Attributed Network Embedding model (BANE for short) to learn binary node representation. Specifically, we define a new Weisfeiler-Lehman proximity matrix to capture data dependence between node links and attributes by aggregating the information of node attributes and links from neighboring nodes to a given target node in a layer-wise manner. Based on the Weisfeiler-Lehman proximity matrix, we formulate a new Weisfiler-Lehman matrix factorization learning function under the binary node representation constraint. The learning problem is a mixed integer optimization and an efficient cyclic coordinate descent (CCD) algorithm is used as the solution. Node classification and link prediction experiments on real-world datasets show that the proposed BANE model outperforms the state-of-the-art network embedding methods.

📄 PDF Abstract BibTeX

Code (2)

benedekrozemberczki/BANE
benedekrozemberczki/karateclub

Tasks

Graph EmbeddingLink PredictionNetwork EmbeddingNode ClassificationRepresentation Learning

Similar Papers 제목 키워드 기반

BiBERT: Accurate Fully Binarized BERT

2022-03-12 · ICLR 2022 4 · Haotong Qin, Yifu Ding, Mingyuan Zhang, Qinghua Yan 외

The large pre-trained BERT has achieved remarkable performance on Natural Language Processing (NLP) tasks but is also computation and memory expensive. As one of the powerful compression approaches, binarization extremel…

Binarization

A Greedy Bit-flip Training Algorithm for Binarized Knowledge Graph Embeddings

2020-11-01 · Findings of the Association for Computational Linguistics 2020 · Katsuhiko Hayashi, Koki Kishimoto, Masashi Shimbo

This paper presents a simple and effective discrete optimization method for training binarized knowledge graph embedding model B-CP. Unlike the prior work using a SGD-based method and quantization of real-valued vectors,…

Graph EmbeddingKnowledge Graph CompletionKnowledge Graph EmbeddingKnowledge Graph Embeddings+1

Binarized Graph Neural Network

2020-04-19 · Hanchen Wang, Defu Lian, Ying Zhang, Lu Qin 외

Recently, there have been some breakthroughs in graph analysis by applying the graph neural networks (GNNs) following a neighborhood aggregation scheme, which demonstrate outstanding performance in many tasks. However, w…

Graph EmbeddingGraph Neural Network

End to End Binarized Neural Networks for Text Classification

2020-10-11 · EMNLP (sustainlp) 2020 11 · Harshil Jain, Akshat Agarwal, Kumar Shridhar, Denis Kleyko

Deep neural networks have demonstrated their superior performance in almost every Natural Language Processing task, however, their increasing complexity raises concerns. In particular, these networks require high expense…

BinarizationClassificationGeneral Classificationintent-classification+3

Binarized Canonical Polyadic Decomposition for Knowledge Graph Completion

2019-12-04 · Koki Kishimoto, Katsuhiko Hayashi, Genki Akai, Masashi Shimbo

Methods based on vector embeddings of knowledge graphs have been actively pursued as a promising approach to knowledge graph completion.However, embedding models generate storage-inefficient representations, particularly…

Knowledge Graph CompletionKnowledge Graphs