paper-with-me

홈 › Papers

Attention Models with Random Features for Multi-layered Graph Embeddings

2018-10-02 · Uday Shankar Shanthamallu, Jayaraman J. Thiagarajan, Huan Song, Andreas Spanias

Modern data analysis pipelines are becoming increasingly complex due to the presence of multi-view information sources. While graphs are effective in modeling complex relationships, in many scenarios a single graph is rarely sufficient to succinctly represent all interactions, and hence multi-layered graphs have become popular. Though this leads to richer representations, extending solutions from the single-graph case is not straightforward. Consequently, there is a strong need for novel solutions to solve classical problems, such as node classification, in the multi-layered case. In this paper, we consider the problem of semi-supervised learning with multi-layered graphs. Though deep network embeddings, e.g. DeepWalk, are widely adopted for community discovery, we argue that feature learning with random node attributes, using graph neural networks, can be more effective. To this end, we propose to use attention models for effective feature learning, and develop two novel architectures, GrAMME-SG and GrAMME-Fusion, that exploit the inter-layer dependencies for building multi-layered graph embeddings. Using empirical studies on several benchmark datasets, we evaluate the proposed approaches and demonstrate significant performance improvements in comparison to state-of-the-art network embedding strategies. The results also show that using simple random features is an effective choice, even in cases where explicit node attributes are not available.

📄 PDF Abstract BibTeX arXiv:1810.01405

Code (0)

등록된 구현이 없습니다.

Tasks

Network EmbeddingNode Classification

Methods 이 논문이 사용한 방법론

DeepWalk DeepWalk learns embeddings (social representations) of a graph's vertices, by modeling a stream of short random walks. Social representations are latent features of the…

Similar Papers 제목 키워드 기반

Knowledge-enriched Two-layered Attention Network for Sentiment Analysis

2018-05-20 · NAACL 2018 6 · Abhishek Kumar, Daisuke Kawahara, Sadao Kurohashi

We propose a novel two-layered attention network based on Bidirectional Long Short-Term Memory for sentiment analysis. The novel two-layered attention network takes advantage of the external knowledge bases to improve th…

Graph EmbeddingKnowledge Graph EmbeddingSentiment AnalysisVocal Bursts Valence Prediction

GenLayNeRF: Generalizable Layered Representations with 3D Model Alignment for Multi-Human View Synthesis

2023-09-20 · Youssef Abdelkareem, Shady Shehata, Fakhri Karray

Novel view synthesis (NVS) of multi-human scenes imposes challenges due to the complex inter-human occlusions. Layered representations handle the complexities by dividing the scene into multi-layered radiance fields, how…

NeRFNovel View Synthesis

Phase Conductor on Multi-layered Attentions for Machine Comprehension

2017-10-28 · ICLR 2018 1 · Rui Liu, Wei Wei, Weiguang Mao, Maria Chikina

Attention models have been intensively studied to improve NLP tasks such as machine comprehension via both question-aware passage attention model and self-matching attention model. Our research proposes phase conductor (…

Question AnsweringReading Comprehension

MaxCorrMGNN: A Multi-Graph Neural Network Framework for Generalized Multimodal Fusion of Medical Data for Outcome Prediction

2023-07-13 · Niharika S. D'Souza, Hongzhi Wang, Andrea Giovannini, Antonio Foncubierta-Rodriguez 외

With the emergence of multimodal electronic health records, the evidence for an outcome may be captured across multiple modalities ranging from clinical to imaging and genomic data. Predicting outcomes effectively requir…

Graph Neural Network

Internal Structure Attention Network for Fingerprint Presentation Attack Detection from Optical Coherence Tomography

2023-03-20 · Haohao Sun, Yilong Zhang, Peng Chen, Haixia Wang 외

As a non-invasive optical imaging technique, optical coherence tomography (OCT) has proven promising for automatic fingerprint recognition system (AFRS) applications. Diverse approaches have been proposed for OCT-based f…

Domain Generalization