paper-with-me

Papers

Principal Graph Encoder Embedding and Principal Community Detection

2025-01-24 · Cencheng Shen, Yuexiao Dong, Carey E. Priebe, Jonathan Larson, Ha Trinh, Youngser Park

In this paper, we introduce the concept of principal communities and propose a principal graph encoder embedding method that concurrently detects these communities and achieves vertex embedding. Given a graph adjacency matrix with vertex labels, the method computes a sample community score for each community, ranking them to measure community importance and estimate a set of principal communities. The method then produces a vertex embedding by retaining only the dimensions corresponding to these principal communities. Theoretically, we define the population version of the encoder embedding and the community score based on a random Bernoulli graph distribution. We prove that the population principal graph encoder embedding preserves the conditional density of the vertex labels and that the population community score successfully distinguishes the principal communities. We conduct a variety of simulations to demonstrate the finite-sample accuracy in detecting ground-truth principal communities, as well as the advantages in embedding visualization and subsequent vertex classification. The method is further applied to a set of real-world graphs, showcasing its numerical advantages, including robustness to label noise and computational scalability.

📄 PDF Abstract BibTeX arXiv:2501.14939

Code (0)

등록된 구현이 없습니다.

Tasks

Community Detection

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Symmetry-Aware Autoencoders: s-PCA and s-nlPCA

2021-11-04 · Simon Kneer, Taraneh Sayadi, Denis Sipp, Peter Schmid 외

Nonlinear principal component analysis (NLPCA) via autoencoders has attracted attention in the dynamical systems community due to its larger compression rate when compared to linear principal component analysis (PCA). Th…

Autoencoding Improves Pre-trained Word Embeddings

2020-10-25 · COLING 2020 8 · Masahiro Kaneko, Danushka Bollegala

Prior work investigating the geometry of pre-trained word embeddings have shown that word embeddings to be distributed in a narrow cone and by centering and projecting using principal component vectors one can increase t…

Word Embeddings

Comparing the Performance of Feature Representations for the Categorization of the Easy-to-Read Variety vs Standard Language

2019-09-01 · WS (NoDaLiDa) 2019 9 · Marina Santini, Benjamin Danielsson, Arne Jönsson

We explore the effectiveness of four feature representations – bag-of-words, word embeddings, principal components and autoencoders – for the binary categorization of the easy-to-read variety vs standard language. Standa…

Word Embeddings

Principal Word Vectors

2020-07-09 · Ali Basirat, Christian Hardmeier, Joakim Nivre

We generalize principal component analysis for embedding words into a vector space. The generalization is made in two major levels. The first is to generalize the concept of the corpus as a counting process which is defi…

Dependency ParsingWord Similarity

From Principal Subspaces to Principal Components with Linear Autoencoders

2018-04-26 · Elad Plaut

The autoencoder is an effective unsupervised learning model which is widely used in deep learning. It is well known that an autoencoder with a single fully-connected hidden layer, a linear activation function and a squar…

Dimensionality Reduction