paper-with-me

홈 › Papers

Conditional Network Embeddings

2018-05-19 · ICLR 2019 5 · Bo Kang, Jefrey Lijffijt, Tijl De Bie

Network Embeddings (NEs) map the nodes of a given network into $d$-dimensional Euclidean space $\mathbb{R}^d$. Ideally, this mapping is such that similar' nodes are mapped onto nearby points, such that the NE can be used for purposes such as link prediction (if similar' means being more likely to be connected') or classification (if similar' means `being more likely to have the same label'). In recent years various methods for NE have been introduced, all following a similar strategy: defining a notion of similarity between nodes (typically some distance measure within the network), a distance measure in the embedding space, and a loss function that penalizes large distances for similar nodes and small distances for dissimilar nodes. A difficulty faced by existing methods is that certain networks are fundamentally hard to embed due to their structural properties: (approximate) multipartiteness, certain degree distributions, assortativity, etc. To overcome this, we introduce a conceptual innovation to the NE literature and propose to create \emph{Conditional Network Embeddings} (CNEs); embeddings that maximally add information with respect to given structural properties (e.g. node degrees, block densities, etc.). We use a simple Bayesian approach to achieve this, and propose a block stochastic gradient descent algorithm for fitting it efficiently. We demonstrate that CNEs are superior for link prediction and multi-label classification when compared to state-of-the-art methods, and this without adding significant mathematical or computational complexity. Finally, we illustrate the potential of CNE for network visualization.

📄 PDF Abstract BibTeX arXiv:1805.07544

Code (0)

등록된 구현이 없습니다.

Tasks

General ClassificationLink PredictionMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATION

Similar Papers 제목 키워드 기반

Bayesian Deconditional Kernel Mean Embeddings

2019-06-01 · Kelvin Hsu, Fabio Ramos

Conditional kernel mean embeddings form an attractive nonparametric framework for representing conditional means of functions, describing the observation processes for many complex models. However, the recovery of the or…

Gaussian Processes

LLM-Assisted Content Conditional Debiasing for Fair Text Embedding

2024-02-22 · Wenlong Deng, Blair Chen, Beidi Zhao, Chiyu Zhang 외

Mitigating biases in machine learning models has become an increasing concern in Natural Language Processing (NLP), particularly in developing fair text embeddings, which are crucial yet challenging for real-world applic…

Fairness

Following the Autoregressive Nature of LLM Embeddings via Compression and Alignment

2025-02-17 · Jingcheng Deng, Zhongtao Jiang, Liang Pang, Liwei Chen 외

A new trend uses LLMs as dense text encoders via contrastive learning. However, since LLM embeddings predict the probability distribution of the next token, they are inherently generative and distributive, conflicting wi…

Contrastive Learning

Measuring Differences between Conditional Distributions using Kernel Embeddings

2026-05-04 · Peter Moskvichev, Siu Lun Chau, Dino Sejdinovic arxiv

Comparing conditional distributions is a fundamental challenge in statistics and machine learning, with applications across a wide range of domains. While proposed methods for measuring discrepancies using kernel embeddi…

Sobolev Norm Learning Rates for Conditional Mean Embeddings

2021-05-16 · Prem Talwai, Ali Shameli, David Simchi-Levi

We develop novel learning rates for conditional mean embeddings by applying the theory of interpolation for reproducing kernel Hilbert spaces (RKHS). We derive explicit, adaptive convergence rates for the sample estimato…