paper-with-me

Papers

DeepWalking Backwards: From Embeddings Back to Graphs

2021-02-17 · Sudhanshu Chanpuriya, Cameron Musco, Konstantinos Sotiropoulos, Charalampos E. Tsourakakis

Low-dimensional node embeddings play a key role in analyzing graph datasets. However, little work studies exactly what information is encoded by popular embedding methods, and how this information correlates with performance in downstream machine learning tasks. We tackle this question by studying whether embeddings can be inverted to (approximately) recover the graph used to generate them. Focusing on a variant of the popular DeepWalk method (Perozzi et al., 2014; Qiu et al., 2018), we present algorithms for accurate embedding inversion - i.e., from the low-dimensional embedding of a graph G, we can find a graph H with a very similar embedding. We perform numerous experiments on real-world networks, observing that significant information about G, such as specific edges and bulk properties like triangle density, is often lost in H. However, community structure is often preserved or even enhanced. Our findings are a step towards a more rigorous understanding of exactly what information embeddings encode about the input graph, and why this information is useful for learning tasks.

📄 PDF Abstract BibTeX arXiv:2102.08532

Code (1)

konsotirop/Invert_Embeddings 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

DeepWalk DeepWalk learns embeddings (social representations) of a graph's vertices, by modeling a stream of short random walks. Social representations are latent features of the…

Similar Papers 제목 키워드 기반

Clique pooling for graph classification

2019-03-31 · Enxhell Luzhnica, Ben Day, Pietro Lio'

We propose a novel graph pooling operation using cliques as the unit pool. As this approach is purely topological, rather than featural, it is more readily interpretable, a better analogue to image coarsening than filter…

ClassificationGeneral ClassificationGraph Classification

Seeing the Arrow of Time

2014-06-01 · CVPR 2014 6 · Lyndsey C. Pickup, Zheng Pan, Donglai Wei, YiChang Shih 외

We explore whether we can observe Time's Arrow in a temporal sequence--is it possible to tell whether a video is running forwards or backwards? We investigate this somewhat philosophical question using computer vision an…

General ClassificationVideo Compression

Activation Relaxation: A Local Dynamical Approximation to Backpropagation in the Brain

2020-09-11 · Beren Millidge, Alexander Tschantz, Anil. K. Seth, Christopher L. Buckley

The backpropagation of error algorithm (backprop) has been instrumental in the recent success of deep learning. However, a key question remains as to whether backprop can be formulated in a manner suitable for implementa…

Recursive Backwards Q-Learning in Deterministic Environments

2024-04-24 · Jan Diekhoff, Jörn Fischer

Reinforcement learning is a popular method of finding optimal solutions to complex problems. Algorithms like Q-learning excel at learning to solve stochastic problems without a model of their environment. However, they t…

Q-Learning

Decoupled Neural Interfaces using Synthetic Gradients

2016-08-18 · ICML 2017 8 · Max Jaderberg, Wojciech Marian Czarnecki, Simon Osindero, Oriol Vinyals 외

Training directed neural networks typically requires forward-propagating data through a computation graph, followed by backpropagating error signal, to produce weight updates. All layers, or more generally, modules, of t…