paper-with-me

홈 › Papers

Creating generalizable downstream graph models with random projections

2023-02-17 · Anton Amirov, Chris Quirk, Jennifer Neville

We investigate graph representation learning approaches that enable models to generalize across graphs: given a model trained using the representations from one graph, our goal is to apply inference using those same model parameters when given representations computed over a new graph, unseen during model training, with minimal degradation in inference accuracy. This is in contrast to the more common task of doing inference on the unseen nodes of the same graph. We show that using random projections to estimate multiple powers of the transition matrix allows us to build a set of isomorphism-invariant features that can be used by a variety of tasks. The resulting features can be used to recover enough information about the local neighborhood of a node to enable inference with relevance competitive to other approaches while maintaining computational efficiency.

📄 PDF Abstract BibTeX arXiv:2302.08895

Code (0)

등록된 구현이 없습니다.

Tasks

Computational EfficiencyGraph Representation LearningRepresentation Learning

Similar Papers 제목 키워드 기반

Random Projections of Sparse Adjacency Matrices

2023-09-04 · Frank Qiu

We analyze a random projection method for adjacency matrices, studying its utility in representing sparse graphs. We show that these random projections retain the functionality of their underlying adjacency matrices whil…

Node Similarities under Random Projections: Limits and Pathological Cases

2024-04-15 · Tvrtko Tadić, Cassiano Becker, Jennifer Neville

Random Projections have been widely used to generate embeddings for various graph learning tasks due to their computational efficiency. The majority of applications have been justified through the Johnson-Lindenstrauss L…

Computational EfficiencyGraph LearningLEMMA

Looking Beyond Sentence-Level Natural Language Inference for Downstream Tasks

2020-09-18 · Anshuman Mishra, Dhruvesh Patel, Aparna Vijayakumar, Xiang Li 외

In recent years, the Natural Language Inference (NLI) task has garnered significant attention, with new datasets and models achieving near human-level performance on it. However, the full promise of NLI -- particularly t…

Natural Language InferenceQuestion AnsweringSentenceText Summarization

Debiasing Random Oblique Projections for Subsampled OLS and Fast CUR in High Dimensions

2026-05-24 · Chengmei Niu, Sachin Garg, Michał Dereziński, Zhenyu Liao arxiv

Random sampling is a fundamental tool in modern machine learning and numerical linear algebra for reducing the computational cost of large-scale matrix problems. Existing analyses, however, rely primarily on subspace emb…

NodeSig: Binary Node Embeddings via Random Walk Diffusion

2020-10-01 · Abdulkadir Çelikkanat, Fragkiskos D. Malliaros, Apostolos N. Papadopoulos

Graph Representation Learning (GRL) has become a key paradigm in network analysis, with a plethora of interdisciplinary applications. As the scale of networks increases, most of the widely used learning-based graph repre…

Graph Representation LearningLink PredictionNode ClassificationRepresentation Learning