Conditional Network Embeddings
Network Embeddings (NEs) map the nodes of a given network into
$d$-dimensional Euclidean space $\mathbb{R}^d$. Ideally, this mapping is such
that similar' nodes are mapped onto nearby points, such that the NE can be
used for purposes such as link prediction (if similar' means being more
likely to be connected') or classification (if similar' means `being more
likely to have the same label'). In recent years various methods for NE have
been introduced, all following a similar strategy: defining a notion of
similarity between nodes (typically some distance measure within the network),
a distance measure in the embedding space, and a loss function that penalizes
large distances for similar nodes and small distances for dissimilar nodes.
A difficulty faced by existing methods is that certain networks are
fundamentally hard to embed due to their structural properties: (approximate)
multipartiteness, certain degree distributions, assortativity, etc. To overcome
this, we introduce a conceptual innovation to the NE literature and propose to
create \emph{Conditional Network Embeddings} (CNEs); embeddings that maximally
add information with respect to given structural properties (e.g. node degrees,
block densities, etc.). We use a simple Bayesian approach to achieve this, and
propose a block stochastic gradient descent algorithm for fitting it
efficiently. We demonstrate that CNEs are superior for link prediction and
multi-label classification when compared to state-of-the-art methods, and this
without adding significant mathematical or computational complexity. Finally,
we illustrate the potential of CNE for network visualization.
Code (0)
등록된 구현이 없습니다.
Tasks
General ClassificationLink PredictionMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONSimilar Papers 제목 키워드 기반
Bayesian Deconditional Kernel Mean Embeddings
Conditional kernel mean embeddings form an attractive nonparametric framework for representing conditional means of functions, describing the observation processes for many complex models. However, the recovery of the or…
Gaussian ProcessesLLM-Assisted Content Conditional Debiasing for Fair Text Embedding
Mitigating biases in machine learning models has become an increasing concern in Natural Language Processing (NLP), particularly in developing fair text embeddings, which are crucial yet challenging for real-world applic…
FairnessFollowing the Autoregressive Nature of LLM Embeddings via Compression and Alignment
A new trend uses LLMs as dense text encoders via contrastive learning. However, since LLM embeddings predict the probability distribution of the next token, they are inherently generative and distributive, conflicting wi…
Contrastive LearningMeasuring Differences between Conditional Distributions using Kernel Embeddings
Comparing conditional distributions is a fundamental challenge in statistics and machine learning, with applications across a wide range of domains. While proposed methods for measuring discrepancies using kernel embeddi…
Sobolev Norm Learning Rates for Conditional Mean Embeddings
We develop novel learning rates for conditional mean embeddings by applying the theory of interpolation for reproducing kernel Hilbert spaces (RKHS). We derive explicit, adaptive convergence rates for the sample estimato…