paper-with-me

Papers

Semi-Supervised Graph Learning Meets Dimensionality Reduction

2022-03-23 · Alex Morehead, Watchanan Chantapakul, Jianlin Cheng

Semi-supervised learning (SSL) has recently received increased attention from machine learning researchers. By enabling effective propagation of known labels in graph-based deep learning (GDL) algorithms, SSL is poised to become an increasingly used technique in GDL in the coming years. However, there are currently few explorations in the graph-based SSL literature on exploiting classical dimensionality reduction techniques for improved label propagation. In this work, we investigate the use of dimensionality reduction techniques such as PCA, t-SNE, and UMAP to see their effect on the performance of graph neural networks (GNNs) designed for semi-supervised propagation of node labels. Our study makes use of benchmark semi-supervised GDL datasets such as the Cora and Citeseer datasets to allow meaningful comparisons of the representations learned by each algorithm when paired with a dimensionality reduction technique. Our comprehensive benchmarks and clustering visualizations quantitatively and qualitatively demonstrate that, under certain conditions, employing a priori and a posteriori dimensionality reduction to GNN inputs and outputs, respectively, can simultaneously improve the effectiveness of semi-supervised node label propagation and node clustering. Our source code is freely available on GitHub.

📄 PDF Abstract BibTeX arXiv:2203.12522

Code (1)

amorehead/SSL-With-DR-And-GNNs 공식 구현 pytorch

Tasks

ClusteringDimensionality ReductionGraph LearningNode Clustering

Methods 이 논문이 사용한 방법론

PCA Principle Components Analysis (PCA) is an unsupervised method primary used for dimensionality reduction within machine learning. PCA is calculated via a singular value…

Similar Papers 제목 키워드 기반

Semi-supervised Regression using Hessian energy with an application to semi-supervised dimensionality reduction

2009-12-01 · NeurIPS 2009 12 · Kwang I. Kim, Florian Steinke, Matthias Hein

Semi-supervised regression based on the graph Laplacian suffers from the fact that the solution is biased towards a constant and the lack of extrapolating power. Outgoing from these observations we propose to use the sec…

Dimensionality ReductionregressionSupervised dimensionality reduction

Dimensionality Reduction Meets Message Passing for Graph Node Embeddings

2022-02-01 · Krzysztof Sadowski, Michał Szarmach, Eddie Mattia

Graph Neural Networks (GNNs) have become a popular approach for various applications, ranging from social network analysis to modeling chemical properties of molecules. While GNNs often show remarkable performance on pub…

Dimensionality ReductionNode ClassificationNode Property Prediction

Scalable semi-supervised dimensionality reduction with GPU-accelerated EmbedSOM

2022-01-03 · Adam Šmelko, Soňa Molnárová, Miroslav Kratochvíl, Abhishek Koladiya 외

Dimensionality reduction methods have found vast application as visualization tools in diverse areas of science. Although many different methods exist, their performance is often insufficient for providing quick insight …

Data VisualizationDimensionality ReductionGPUSupervised dimensionality reduction

Graph Laplacian Regularized Graph Convolutional Networks for Semi-supervised Learning

2018-09-26 · Bo Jiang, Doudou Lin

Recently, graph convolutional network (GCN) has been widely used for semi-supervised classification and deep feature representation on graph-structured data. However, existing GCN generally fails to consider the local in…

ClassificationDimensionality ReductionGeneral Classification

Unified Framework for Spectral Dimensionality Reduction, Maximum Variance Unfolding, and Kernel Learning By Semidefinite Programming: Tutorial and Survey

2021-06-29 · Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley

This is a tutorial and survey paper on unification of spectral dimensionality reduction methods, kernel learning by Semidefinite Programming (SDP), Maximum Variance Unfolding (MVU) or Semidefinite Embedding (SDE), and it…

Dimensionality Reduction