paper-with-me

Papers

Building Trust in Black-box Optimization: A Comprehensive Framework for Explainability

2024-10-18 · Nazanin Nezami, Hadis Anahideh

Optimizing costly black-box functions within a constrained evaluation budget presents significant challenges in many real-world applications. Surrogate Optimization (SO) is a common resolution, yet its proprietary nature introduced by the complexity of surrogate models and the sampling core (e.g., acquisition functions) often leads to a lack of explainability and transparency. While existing literature has primarily concentrated on enhancing convergence to global optima, the practical interpretation of newly proposed strategies remains underexplored, especially in batch evaluation settings. In this paper, we propose \emph{Inclusive} Explainability Metrics for Surrogate Optimization (IEMSO), a comprehensive set of model-agnostic metrics designed to enhance the transparency, trustworthiness, and explainability of the SO approaches. Through these metrics, we provide both intermediate and post-hoc explanations to practitioners before and after performing expensive evaluations to gain trust. We consider four primary categories of metrics, each targeting a specific aspect of the SO process: Sampling Core Metrics, Batch Properties Metrics, Optimization Process Metrics, and Feature Importance. Our experimental evaluations demonstrate the significant potential of the proposed metrics across different benchmarks.

📄 PDF Abstract BibTeX arXiv:2410.14573

Code (0)

등록된 구현이 없습니다.

Tasks

Feature Importance

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

TREGO: a Trust-Region Framework for Efficient Global Optimization

2021-01-18 · Youssef Diouane, Victor Picheny, Rodolphe Le Riche, Alexandre Scotto Di Perrotolo

Efficient Global Optimization (EGO) is the canonical form of Bayesian optimization that has been successfully applied to solve global optimization of expensive-to-evaluate black-box problems. However, EGO struggles to sc…

Bayesian Optimizationglobal-optimization

DuTrust: A Sentiment Analysis Dataset for Trustworthiness Evaluation

2021-08-30 · Lijie Wang, Hao liu, Shuyuan Peng, Hongxuan Tang 외

While deep learning models have greatly improved the performance of most artificial intelligence tasks, they are often criticized to be untrustworthy due to the black-box problem. Consequently, many works have been propo…

Sentiment Analysis

Fast Black-box Variational Inference through Stochastic Trust-Region Optimization

2017-06-07 · NeurIPS 2017 12 · Jeffrey Regier, Michael. I. Jordan, Jon Mcauliffe

We introduce TrustVI, a fast second-order algorithm for black-box variational inference based on trust-region optimization and the reparameterization trick. At each iteration, TrustVI proposes and assesses a step based o…

Variational Inference

TriAlignXA: An Explainable Trilemma Alignment Framework for Trustworthy Agri-product Grading

2025-10-02 · Jianfei Xie, Ziyang Li arxiv

The 'trust deficit' in online fruit and vegetable e-commerce stems from the inability of digital transactions to provide direct sensory perception of product quality. This paper constructs a 'Trust Pyramid' model through…

Explanation-Guided Fair Federated Learning for Transparent 6G RAN Slicing

2023-07-18 · Swastika Roy, Hatim Chergui, Christos Verikoukis

Future zero-touch artificial intelligence (AI)-driven 6G network automation requires building trust in the AI black boxes via explainable artificial intelligence (XAI), where it is expected that AI faithfulness would be …

Explainable artificial intelligenceExplainable Artificial Intelligence (XAI)FairnessFederated Learning