paper-with-me

Papers

Generating Post-hoc Explanations for Skip-gram-based Node Embeddings by Identifying Important Nodes with Bridgeness

2023-04-24 · Hogun Park, Jennifer Neville

Node representation learning in a network is an important machine learning technique for encoding relational information in a continuous vector space while preserving the inherent properties and structures of the network. Recently, unsupervised node embedding methods such as DeepWalk, LINE, struc2vec, PTE, UserItem2vec, and RWJBG have emerged from the Skip-gram model and perform better performance in several downstream tasks such as node classification and link prediction than the existing relational models. However, providing post-hoc explanations of Skip-gram-based embeddings remains a challenging problem because of the lack of explanation methods and theoretical studies applicable for embeddings. In this paper, we first show that global explanations to the Skip-gram-based embeddings can be found by computing bridgeness under a spectral cluster-aware local perturbation. Moreover, a novel gradient-based explanation method, which we call GRAPH-wGD, is proposed that allows the top-q global explanations about learned graph embedding vectors more efficiently. Experiments show that the ranking of nodes by scores using GRAPH-wGD is highly correlated with true bridgeness scores. We also observe that the top-q node-level explanations selected by GRAPH-wGD have higher importance scores and produce more changes in class label prediction when perturbed, compared with the nodes selected by recent alternatives, using five real-world graphs.

📄 PDF Abstract BibTeX arXiv:2304.12036

Code (0)

등록된 구현이 없습니다.

Tasks

Graph EmbeddingLink PredictionNode ClassificationRepresentation Learning

Methods 이 논문이 사용한 방법론

DeepWalk DeepWalk learns embeddings (social representations) of a graph's vertices, by modeling a stream of short random walks. Social representations are latent features of the…
LINE 설명 없음

Similar Papers 제목 키워드 기반

Distilling neural networks into skipgram-level decision lists

2020-05-14 · Madhumita Sushil, Simon Šuster, Walter Daelemans

Several previous studies on explanation for recurrent neural networks focus on approaches that find the most important input segments for a network as its explanations. In that case, the manner in which these input segme…

Sentiment Analysis

Fast Node Embeddings: Learning Ego-Centric Representations

2018-01-01 · ICLR 2018 1 · Tiago Pimentel, Adriano Veloso, Nivio Ziviani

Representation learning is one of the foundations of Deep Learning and allowed important improvements on several Machine Learning tasks, such as Neural Machine Translation, Question Answering and Speech Recognition. Rece…

Link PredictionMachine TranslationNode ClassificationQuestion Answering+4

Comprehend DeepWalk as Matrix Factorization

2015-01-02 · Cheng Yang, Zhiyuan Liu

Word2vec, as an efficient tool for learning vector representation of words has shown its effectiveness in many natural language processing tasks. Mikolov et al. issued Skip-Gram and Negative Sampling model for developing…

Structure-Preference Enabled Graph Embedding Generation under Differential Privacy

2025-01-07 · Sen Zhang, Qingqing Ye, Haibo Hu

Graph embedding generation techniques aim to learn low-dimensional vectors for each node in a graph and have recently gained increasing research attention. Publishing low-dimensional node vectors enables various graph an…

Graph EmbeddingGraph LearningLink Prediction

Optimal Counterfactual Explanations for Scorecard modelling

2021-04-17 · Guillermo Navas-Palencia

Counterfactual explanations is one of the post-hoc methods used to provide explainability to machine learning models that have been attracting attention in recent years. Most examples in the literature, address the probl…

BIG-bench Machine LearningcounterfactualCPUDiversity