paper-with-me

홈 › Papers

Shapley-Guided Neural Repair Approach via Derivative-Free Optimization

2026-04-01 · Xinyu Sun, Wanwei Liu, Haoang Chi, Tingyu Chen, Xiaoguang Mao, Shangwen Wang, Lei Bu, Jingyi Wang, Yang Tan, Zhenyi Qi arxiv

DNNs are susceptible to defects like backdoors, adversarial attacks, and unfairness, undermining their reliability. Existing approaches mainly involve retraining, optimization, constraint-solving, or search algorithms. However, most methods rely on gradient calculations, restricting applicability to specific activation functions (e.g., ReLU), or use search algorithms with uninterpretable localization and repair. Furthermore, they often lack generalizability across multiple properties. We propose SHARPEN, integrating interpretable fault localization with a derivative-free optimization strategy. First, SHARPEN introduces a Deep SHAP-based localization strategy quantifying each layer's and neuron's marginal contribution to erroneous outputs. Specifically, a hierarchical coarse-to-fine approach reranks layers by aggregated impact, then locates faulty neurons/filters by analyzing activation divergences between property-violating and benign states. Subsequently, SHARPEN incorporates CMA-ES to repair identified neurons. CMA-ES leverages a covariance matrix to capture variable dependencies, enabling gradient-free search and coordinated adjustments across coupled neurons. By combining interpretable localization with evolutionary optimization, SHARPEN enables derivative-free repair across architectures, being less sensitive to gradient anomalies and hyperparameters. We demonstrate SHARPEN's effectiveness on three repair tasks. Balancing property repair and accuracy preservation, it outperforms baselines in backdoor removal (+10.56%), adversarial mitigation (+5.78%), and unfairness repair (+11.82%). Notably, SHARPEN handles diverse tasks, and its modular design is plug-and-play with different derivative-free optimizers, highlighting its flexibility.

📄 PDF Abstract BibTeX arXiv:2604.00422

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Derivative-based Shapley value for global sensitivity analysis and machine learning explainability

2023-03-24 · Hui Duan, Giray Ökten

We introduce a new Shapley value approach for global sensitivity analysis and machine learning explainability. The method is based on the first-order partial derivatives of the underlying function. The computational comp…

Sensitivity

Few-shot Backdoor Defense Using Shapley Estimation

2021-12-30 · CVPR 2022 1 · Jiyang Guan, Zhuozhuo Tu, Ran He, DaCheng Tao

Deep neural networks have achieved impressive performance in a variety of tasks over the last decade, such as autonomous driving, face recognition, and medical diagnosis. However, prior works show that deep neural networ…

Autonomous Drivingbackdoor defenseFace RecognitionMedical Diagnosis

Shapley-Guided Utility Learning for Effective Graph Inference Data Valuation

2025-03-23 · Hongliang Chi, Qiong Wu, Zhengyi Zhou, Yao Ma

Graph Neural Networks (GNNs) have demonstrated remarkable performance in various graph-based machine learning tasks, yet evaluating the importance of neighbors of testing nodes remains largely unexplored due to the chall…

Data ValuationValue prediction

Enhancing Optimization Performance: A Novel Hybridization of Gaussian Crunching Search and Powell's Method for Derivative-Free Optimization

2023-08-09 · Benny Wong

This research paper presents a novel approach to enhance optimization performance through the hybridization of Gaussian Crunching Search (GCS) and Powell's Method for derivative-free optimization. While GCS has shown pro…

Towards Valid B-Rep Generation: Training-Free Wireframe Anomaly Detection and Repair

2026-08-05 · Jingyu Wu, Youcheng Cai, Tengyu Luo, Ligang Liu arxiv

Multi-stage boundary representation (B-Rep) generation leverages intermediate wireframes to synthesize CAD models. However, geometric and topological risks in these wireframes -- such as self-intersections, edge collapse…

Anomaly Detection