SAFE ML: Surrogate Assisted Feature Extraction for Model Learning
Complex black-box predictive models may have high accuracy, but opacity causes problems like lack of trust, lack of stability, sensitivity to concept drift. On the other hand, interpretable models require more work related to feature engineering, which is very time consuming. Can we train interpretable and accurate models, without timeless feature engineering? In this article, we show a method that uses elastic black-boxes as surrogate models to create a simpler, less opaque, yet still accurate and interpretable glass-box models. New models are created on newly engineered features extracted/learned with the help of a surrogate model. We show applications of this method for model level explanations and possible extensions for instance level explanations. We also present an example implementation in Python and benchmark this method on a number of tabular data sets.
Code (4)
Tasks
AutoMLFeature EngineeringSimilar Papers 제목 키워드 기반
Surrogate-Assisted Evolution for Efficient Multi-branch Connection Design in Deep Neural Networks
State-of-the-art Deep Neural Networks (DNNs) often incorporate multi-branch connections, enabling multi-scale feature extraction and enhancing the capture of diverse features. This design improves network capacity and ge…
Evolutionary AlgorithmsSurrogate-assisted level-based learning evolutionary search for heat extraction optimization of enhanced geothermal system
An enhanced geothermal system is essential to provide sustainable and long-term geothermal energy supplies and reduce carbon emissions. Optimal well-control scheme for effective heat extraction and improved heat sweep ef…
ManagementSAFE-DNN: A Deep Neural Network with Spike Assisted Feature Extraction for Noise Robust Inference
We present a Deep Neural Network with Spike Assisted Feature Extraction (SAFE-DNN) to improve robustness of classification under stochastic perturbation of inputs. The proposed network augments a DNN with unsupervised le…
ClassificationSurrogate Assisted Pedestrian Protection Design via a Foundation Model Orchestrated Workflow
AI-driven engineering workflows face particular challenges in crash safety design: unlike aerodynamics, crash events involve highly nonlinear contact dynamics, material nonlinearity, and discrete state transitions that a…
Multi-surrogate Assisted Efficient Global Optimization for Discrete Problems
Decades of progress in simulation-based surrogate-assisted optimization and unprecedented growth in computational power have enabled researchers and practitioners to optimize previously intractable complex engineering pr…
global-optimizationManagement