Model-Agnostic Linear Competitors -- When Interpretable Models Compete and Collaborate with Black-Box Models
Driven by an increasing need for model interpretability, interpretable models have become strong competitors for black-box models in many real applications. In this paper, we propose a novel type of model where interpretable models compete and collaborate with black-box models. We present the Model-Agnostic Linear Competitors (MALC) for partially interpretable classification. MALC is a hybrid model that uses linear models to locally substitute any black-box model, capturing subspaces that are most likely to be in a class while leaving the rest of the data to the black-box. MALC brings together the interpretable power of linear models and good predictive performance of a black-box model. We formulate the training of a MALC model as a convex optimization. The predictive accuracy and transparency (defined as the percentage of data captured by the linear models) balance through a carefully designed objective function and the optimization problem is solved with the accelerated proximal gradient method. Experiments show that MALC can effectively trade prediction accuracy for transparency and provide an efficient frontier that spans the entire spectrum of transparency.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Transparency Promotion with Model-Agnostic Linear Competitors
We propose a novel type of hybrid model for multi-class classification, which utilizes competing linear models to collaborate with an existing black-box model, promoting transparency in the decision-making process. Our p…
Decision MakingmodelMulti-class ClassificationInvestment vs. reward in a competitive knapsack problem
Natural selection drives species to develop brains, with sizes that increase with the complexity of the tasks to be tackled. Our goal is to investigate the balance between the metabolic costs of larger brains compared to…
Prices and Concentration: A U-shape? Theory and Evidence from Renewables
We show that when firms compete via supply functions, transferring high-cost capacity to the largest, most efficient firm--thereby diversifying its production technologies while increasing concentration--can lower prices…
Similarity Suppresses Cyclicity: Why Similar Competitors Form Hierarchies
Competitive systems can exhibit both hierarchical (transitive) and cyclic (intransitive) structures. Despite theoretical interest in cyclic competition, which offers richer dynamics, and occupies a larger subset of the s…
FormGaining Free or Low-Cost Transparency with Interpretable Partial Substitute
This work addresses the situation where a black-box model with good predictive performance is chosen over its interpretable competitors, and we show interpretability is still achievable in this case. Our solution is to f…
Decision MakingInterpretable Machine Learning