paper-with-me

Papers

Should Graph Convolution Trust Neighbors? A Simple Causal Inference Method

2020-10-22 · Fuli Feng, Weiran Huang, Xiangnan He, Xin Xin, Qifan Wang, Tat-Seng Chua

Graph Convolutional Network (GCN) is an emerging technique for information retrieval (IR) applications. While GCN assumes the homophily property of a graph, real-world graphs are never perfect: the local structure of a node may contain discrepancy, e.g., the labels of a node's neighbors could vary. This pushes us to consider the discrepancy of local structure in GCN modeling. Existing work approaches this issue by introducing an additional module such as graph attention, which is expected to learn the contribution of each neighbor. However, such module may not work reliably as expected, especially when there lacks supervision signal, e.g., when the labeled data is small. Moreover, existing methods focus on modeling the nodes in the training data, and never consider the local structure discrepancy of testing nodes. This work focuses on the local structure discrepancy issue for testing nodes, which has received little scrutiny. From a novel perspective of causality, we investigate whether a GCN should trust the local structure of a testing node when predicting its label. To this end, we analyze the working mechanism of GCN with causal graph, estimating the causal effect of a node's local structure for the prediction. The idea is simple yet effective: given a trained GCN model, we first intervene the prediction by blocking the graph structure; we then compare the original prediction with the intervened prediction to assess the causal effect of the local structure on the prediction. Through this way, we can eliminate the impact of local structure discrepancy and make more accurate prediction. Extensive experiments on seven node classification datasets show that our method effectively enhances the inference stage of GCN.

📄 PDF Abstract BibTeX arXiv:2010.11797

Code (1)

fulifeng/CGI 공식 구현

Tasks

BlockingCausal InferenceGraph AttentionInformation RetrievalNode ClassificationPredictionRetrieval

Methods 이 논문이 사용한 방법론

Graph Convolutional Networks 설명 없음
GCN A Graph Convolutional Network, or GCN, is an approach for semi-supervised learning on graph-structured data. It is based on an efficient variant of [convolutional neural…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

Learned Neighbor Trust for Collaborative Deployment in Model-Agnostic Decentralized Learning

2026-05-06 · Michael Lanier, Luise Ge, Sastry Kompella, Yevgeniy Vorobeychik arxiv

Many decentralized distillation methods are designed around training-time coordination, yet deploy each node in isolation even when more capable neighbors remain available at inference time. This is an incomplete objecti…

Differential Privacy on Trust Graphs

2024-10-15 · Badih Ghazi, Ravi Kumar, Pasin Manurangsi, Serena Wang

We study differential privacy (DP) in a multi-party setting where each party only trusts a (known) subset of the other parties with its data. Specifically, given a trust graph where vertices correspond to parties and nei…

GmCN: Graph Mask Convolutional Network

2019-09-04 · Bo Jiang, Beibei Wang, Jin Tang, Bin Luo

Graph Convolutional Networks (GCNs) have shown very powerful for graph data representation and learning tasks. Existing GCNs usually conduct feature aggregation on a fixed neighborhood graph in which each node computes i…

Graph Learning

Muffliato: Peer-to-Peer Privacy Amplification for Decentralized Optimization and Averaging

2022-06-10 · Edwige Cyffers, Mathieu Even, Aurélien Bellet, Laurent Massoulié

Decentralized optimization is increasingly popular in machine learning for its scalability and efficiency. Intuitively, it should also provide better privacy guarantees, as nodes only observe the messages sent by their n…

Graph Matching

Adaptive Diffusion in Graph Neural Networks

2021-12-01 · NeurIPS 2021 12 · Jialin Zhao, Yuxiao Dong, Ming Ding, Evgeny Kharlamov 외

The success of graph neural networks (GNNs) largely relies on the process of aggregating information from neighbors defined by the input graph structures. Notably, message passing based GNNs, e.g., graph convolutional ne…