paper-with-me

홈 › Papers

Optimal Decision Trees for the Algorithm Selection Problem: Integer Programming Based Approaches

2019-07-03 · Matheus Guedes Vilas Boas, Haroldo Gambini Santos, Luiz Henrique de Campos Merschmann, Greet Vanden Berghe

Even though it is well known that for most relevant computational problems different algorithms may perform better on different classes of problem instances, most researchers still focus on determining a single best algorithmic configuration based on aggregate results such as the average. In this paper, we propose Integer Programming based approaches to build decision trees for the Algorithm Selection Problem. These techniques allow automate three crucial decisions: (i) discerning the most important problem features to determine problem classes; (ii) grouping the problems into classes and (iii) select the best algorithm configuration for each class. To evaluate this new approach, extensive computational experiments were executed using the linear programming algorithms implemented in the COIN-OR Branch & Cut solver across a comprehensive set of instances, including all MIPLIB benchmark instances. The results exceeded our expectations. While selecting the single best parameter setting across all instances decreased the total running time by 22%, our approach decreased the total running time by 40% on average across 10-fold cross validation experiments. These results indicate that our method generalizes quite well and does not overfit.

📄 PDF Abstract BibTeX arXiv:1907.02211

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

(Machine) Learning to Improve the Empirical Performance of Discrete Algorithms

2021-09-29 · Imran Adham, Jesus De Loera, Zhenyang Zhang

This paper discusses a data-driven, empirically-based framework to make algorithmic decisions or recommendations without expert knowledge. We improve the performance of two algorithmic case studies: the selection of a pi…

BIG-bench Machine Learning

Optimal hypersurface decision trees

2025-09-15 · Xi He arxiv

The study of optimal decision trees has gained increasing attention in recent years; however, despite substantial progress, it still suffers from two major challenges: First, trees constructed by existing optimal decisio…

Provably optimal decision trees with arbitrary splitting rules in polynomial time

2025-03-03 · Xi He, Max A. Little

In this paper, we introduce a generic data structure called decision trees, which integrates several well-known data structures, including binary search trees, K-D trees, binary space partition trees, and decision tree m…

Quant-BnB: A Scalable Branch-and-Bound Method for Optimal Decision Trees with Continuous Features

2022-06-23 · Rahul Mazumder, Xiang Meng, Haoyue Wang

Decision trees are one of the most useful and popular methods in the machine learning toolbox. In this paper, we consider the problem of learning optimal decision trees, a combinatorial optimization problem that is chall…

Combinatorial Optimization

Near Optimal Decision Trees in a SPLIT Second

2025-02-21 · Varun Babbar, Hayden McTavish, Cynthia Rudin, Margo Seltzer

Decision tree optimization is fundamental to interpretable machine learning. The most popular approach is to greedily search for the best feature at every decision point, which is fast but provably suboptimal. Recent app…

Interpretable Machine Learning