Learning Conjoint Attentions for Graph Neural Nets
In this paper, we present Conjoint Attentions (CAs), a class of novel learning-to-attend strategies for graph neural networks (GNNs). Besides considering the layer-wise node features propagated within the GNN, CAs can additionally incorporate various structural interventions, such as node cluster embedding, and higher-order structural correlations that can be learned outside of GNN, when computing attention scores. The node features that are regarded as significant by the conjoint criteria are therefore more likely to be propagated in the GNN. Given the novel Conjoint Attention strategies, we then propose Graph conjoint attention networks (CATs) that can learn representations embedded with significant latent features deemed by the Conjoint Attentions. Besides, we theoretically validate the discriminative capacity of CATs. CATs utilizing the proposed Conjoint Attention strategies have been extensively tested in well-established benchmarking datasets and comprehensively compared with state-of-the-art baselines. The obtained notable performance demonstrates the effectiveness of the proposed Conjoint Attentions.
Code (1)
Tasks
BenchmarkingGraph AttentionSimilar Papers 제목 키워드 기반
Learning Deep Matrix Representations
We present a new distributed representation in deep neural nets wherein the information is represented in native form as a matrix. This differs from current neural architectures that rely on vector representations. We co…
EEGElectroencephalogram (EEG)Face ReconstructionGeneral Classification+1COOL: A Conjoint Perspective on Spatio-Temporal Graph Neural Network for Traffic Forecasting
This paper investigates traffic forecasting, which attempts to forecast the future state of traffic based on historical situations. This problem has received ever-increasing attention in various scenarios and facilitated…
DecoderDiversityGraph Neural NetworkAre Powerful Graph Neural Nets Necessary? A Dissection on Graph Classification
Graph Neural Nets (GNNs) have received increasing attentions, partially due to their superior performance in many node and graph classification tasks. However, there is a lack of understanding on what they are learning a…
ClassificationGeneral ClassificationGraph ClassificationUsing Machine Learning to Test Causal Hypotheses in Conjoint Analysis
Conjoint analysis is a popular experimental design used to measure multidimensional preferences. Researchers examine how varying a factor of interest, while controlling for other relevant factors, influences decision-mak…
BIG-bench Machine LearningDecision MakingExperimental DesignCan LLMs Capture Human Preferences?
We explore the viability of Large Language Models (LLMs), specifically OpenAI's GPT-3.5 and GPT-4, in emulating human survey respondents and eliciting preferences, with a focus on intertemporal choices. Leveraging the ex…
Benchmarking