paper-with-me

Papers

Cooperative Classification and Rationalization for Graph Generalization

2024-03-10 · Linan Yue, Qi Liu, Ye Liu, Weibo Gao, Fangzhou Yao, Wenfeng Li

Graph Neural Networks (GNNs) have achieved impressive results in graph classification tasks, but they struggle to generalize effectively when faced with out-of-distribution (OOD) data. Several approaches have been proposed to address this problem. Among them, one solution is to diversify training distributions in vanilla classification by modifying the data environment, yet accessing the environment information is complex. Besides, another promising approach involves rationalization, extracting invariant rationales for predictions. However, extracting rationales is difficult due to limited learning signals, resulting in less accurate rationales and diminished predictions. To address these challenges, in this paper, we propose a Cooperative Classification and Rationalization (C2R) method, consisting of the classification and the rationalization module. Specifically, we first assume that multiple environments are available in the classification module. Then, we introduce diverse training distributions using an environment-conditional generative network, enabling robust graph representations. Meanwhile, the rationalization module employs a separator to identify relevant rationale subgraphs while the remaining non-rationale subgraphs are de-correlated with labels. Next, we align graph representations from the classification module with rationale subgraph representations using the knowledge distillation methods, enhancing the learning signal for rationales. Finally, we infer multiple environments by gathering non-rationale representations and incorporate them into the classification module for cooperative learning. Extensive experimental results on both benchmarks and synthetic datasets demonstrate the effectiveness of C2R. Code is available at https://github.com/yuelinan/Codes-of-C2R.

📄 PDF Abstract BibTeX arXiv:2403.06239

Code (1)

yuelinan/codes-of-c2r 공식 구현 pytorch

Tasks

ClassificationGraph ClassificationKnowledge Distillation

Methods 이 논문이 사용한 방법론

Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…
ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

Adversarial Cooperative Rationalization: The Risk of Spurious Correlations in Even Clean Datasets

2025-05-04 · Wei Liu, Zhongyu Niu, Lang Gao, Zhiying Deng 외

This study investigates the self-rationalization framework constructed with a cooperative game, where a generator initially extracts the most informative segment from raw input, and a subsequent predictor utilizes the se…

Graph Classificationtext-classificationText Classification

Decoupled Rationalization with Asymmetric Learning Rates: A Flexible Lipschitz Restraint

2023-05-23 · Wei Liu, Jun Wang, Haozhao Wang, Ruixuan Li 외

A self-explaining rationalization model is generally constructed by a cooperative game where a generator selects the most human-intelligible pieces from the input text as rationales, followed by a predictor that makes pr…

Learnable Game-theoretic Policy Optimization for Data-centric Self-explanation Rationalization

2025-10-15 · Yunxiao Zhao, Zhiqiang Wang, Xingtong Yu, Xiaoli Li 외 arxiv

Rationalization, a data-centric framework, aims to build self-explanatory models to explain the prediction outcome by generating a subset of human-intelligible pieces of the input data. It involves a cooperative game mod…

Understanding Interlocking Dynamics of Cooperative Rationalization

2021-10-26 · NeurIPS 2021 12 · Mo Yu, Yang Zhang, Shiyu Chang, Tommi S. Jaakkola

Selective rationalization explains the prediction of complex neural networks by finding a small subset of the input that is sufficient to predict the neural model output. The selection mechanism is commonly integrated in…

Hard Attention

Towards Effective Graph Rationalization via Boosting Environment Diversity

2024-12-17 · Yujie Wang, Kui Yu, Yuhong Zhang, Fuyuan Cao 외

Graph Neural Networks (GNNs) perform effectively when training and testing graphs are drawn from the same distribution, but struggle to generalize well in the face of distribution shifts. To address this issue, existing …

Diversity