paper-with-me

홈 › Papers

Problem-solving benefits of down-sampled lexicase selection

2021-06-10 · Thomas Helmuth, Lee Spector

In genetic programming, an evolutionary method for producing computer programs that solve specified computational problems, parent selection is ordinarily based on aggregate measures of performance across an entire training set. Lexicase selection, by contrast, selects on the basis of performance on random sequences of training cases; this has been shown to enhance problem-solving power in many circumstances. Lexicase selection can also be seen as better reflecting biological evolution, by modeling sequences of challenges that organisms face over their lifetimes. Recent work has demonstrated that the advantages of lexicase selection can be amplified by down-sampling, meaning that only a random subsample of the training cases is used each generation. This can be seen as modeling the fact that individual organisms encounter only subsets of the possible environments, and that environments change over time. Here we provide the most extensive benchmarking of down-sampled lexicase selection to date, showing that its benefits hold up to increased scrutiny. The reasons that down-sampling helps, however, are not yet fully understood. Hypotheses include that down-sampling allows for more generations to be processed with the same budget of program evaluations; that the variation of training data across generations acts as a changing environment, encouraging adaptation; or that it reduces overfitting, leading to more general solutions. We systematically evaluate these hypotheses, finding evidence against all three, and instead draw the conclusion that down-sampled lexicase selection's main benefit stems from the fact that it allows the evolutionary process to examine more individuals within the same computational budget, even though each individual is examined less completely.

📄 PDF Abstract BibTeX arXiv:2106.06085

Code (0)

등록된 구현이 없습니다.

Tasks

Benchmarking

Similar Papers 제목 키워드 기반

Down-Sampled Epsilon-Lexicase Selection for Real-World Symbolic Regression Problems

2023-02-08 · Alina Geiger, Dominik Sobania, Franz Rothlauf

Epsilon-lexicase selection is a parent selection method in genetic programming that has been successfully applied to symbolic regression problems. Recently, the combination of random subsampling with lexicase selection s…

Program SynthesisregressionSymbolic Regression

Informed Down-Sampled Lexicase Selection: Identifying productive training cases for efficient problem solving

2023-01-04 · Ryan Boldi, Martin Briesch, Dominik Sobania, Alexander Lalejini 외

Genetic Programming (GP) often uses large training sets and requires all individuals to be evaluated on all training cases during selection. Random down-sampled lexicase selection evaluates individuals on only a random s…

Program Synthesis

Phylogeny-informed fitness estimation

2023-06-06 · Alexander Lalejini, Matthew Andres Moreno, Jose Guadalupe Hernandez, Emily Dolson

Phylogenies (ancestry trees) depict the evolutionary history of an evolving population. In evolutionary computing, a phylogeny can reveal how an evolutionary algorithm steers a population through a search space, illumina…

DiagnosticDiversityEvolutionary Algorithms

Probabilistic Lexicase Selection

2023-05-19 · Li Ding, Edward Pantridge, Lee Spector

Lexicase selection is a widely used parent selection algorithm in genetic programming, known for its success in various task domains such as program synthesis, symbolic regression, and machine learning. Due to its non-pa…

Program SynthesisregressionSymbolic Regression

An Exploration of Exploration: Measuring the ability of lexicase selection to find obscure pathways to optimality

2021-07-20 · Jose Guadalupe Hernandez, Alexander Lalejini, Charles Ofria

Parent selection algorithms (selection schemes) steer populations through a problem's search space, often trading off between exploitation and exploration. Understanding how selection schemes affect exploitation and expl…

BenchmarkingDiagnostic