paper-with-me

Papers

Robust Ante-hoc Graph Explainer using Bilevel Optimization

2023-05-25 · Kha-Dinh Luong, Mert Kosan, Arlei Lopes da Silva, Ambuj Singh

Explaining the decisions made by machine learning models for high-stakes applications is critical for increasing transparency and guiding improvements to these decisions. This is particularly true in the case of models for graphs, where decisions often depend on complex patterns combining rich structural and attribute data. While recent work has focused on designing so-called post-hoc explainers, the broader question of what constitutes a good explanation remains open. One intuitive property is that explanations should be sufficiently informative to reproduce the predictions given the data. In other words, a good explainer can be repurposed as a predictor. Post-hoc explainers do not achieve this goal as their explanations are highly dependent on fixed model parameters (e.g., learned GNN weights). To address this challenge, we propose RAGE (Robust Ante-hoc Graph Explainer), a novel and flexible ante-hoc explainer designed to discover explanations for graph neural networks using bilevel optimization, with a focus on the chemical domain. RAGE can effectively identify molecular substructures that contain the full information needed for prediction while enabling users to rank these explanations in terms of relevance. Our experiments on various molecular classification tasks show that RAGE explanations are better than existing post-hoc and ante-hoc approaches.

📄 PDF Abstract BibTeX arXiv:2305.15745

Code (0)

등록된 구현이 없습니다.

Tasks

AttributeBilevel OptimizationGraph Classification

Similar Papers 제목 키워드 기반

A Primal-Dual Approach to Bilevel Optimization with Multiple Inner Minima

2022-03-01 · Daouda Sow, Kaiyi Ji, Ziwei Guan, Yingbin Liang

Bilevel optimization has found extensive applications in modern machine learning problems such as hyperparameter optimization, neural architecture search, meta-learning, etc. While bilevel problems with a unique inner mi…

Bilevel OptimizationHyperparameter OptimizationMeta-LearningNeural Architecture Search

Asynchronous Distributed Bilevel Optimization

2022-12-20 · Yang Jiao, Kai Yang, Tiancheng Wu, Dongjin Song 외

Bilevel optimization plays an essential role in many machine learning tasks, ranging from hyperparameter optimization to meta-learning. Existing studies on bilevel optimization, however, focus on either centralized or sy…

Bilevel OptimizationHyperparameter OptimizationMeta-Learning

Nonconvex Decentralized Stochastic Bilevel Optimization under Heavy-Tailed Noise

2025-09-19 · Xinwen Zhang, Yihan Zhang, Heng Liang, Hongchang Gao arxiv

Existing decentralized stochastic optimization methods assume the lower-level loss function is strongly convex and the stochastic gradient noise has finite variance. These strong assumptions typically are not satisfied i…

Stochastic OptimizationBilevel Optimization

Effective Bilevel Optimization via Minimax Reformulation

2023-05-22 · Xiaoyu Wang, Rui Pan, Renjie Pi, Jipeng Zhang

Bilevel optimization has found successful applications in various machine learning problems, including hyper-parameter optimization, data cleaning, and meta-learning. However, its huge computational cost presents a signi…

Bilevel OptimizationMeta-Learning

BloomGML: Graph Machine Learning through the Lens of Bilevel Optimization

2024-03-07 · Amber Yijia Zheng, Tong He, Yixuan Qiu, Minjie Wang 외

Bilevel optimization refers to scenarios whereby the optimal solution of a lower-level energy function serves as input features to an upper-level objective of interest. These optimal features typically depend on tunable …

Bilevel OptimizationGraph LearningGraph Neural NetworkKnowledge Graph Embeddings