paper-with-me

홈 › Papers

Untangling the Effects of Down-Sampling and Selection in Genetic Programming

2023-04-14 · Ryan Boldi, Ashley Bao, Martin Briesch, Thomas Helmuth, Dominik Sobania, Lee Spector, Alexander Lalejini

Genetic programming systems often use large training sets to evaluate the quality of candidate solutions for selection, which is often computationally expensive. Down-sampling training sets has long been used to decrease the computational cost of evaluation in a wide range of application domains. More specifically, recent studies have shown that both random and informed down-sampling can substantially improve problem-solving success for GP systems that use the lexicase parent selection algorithm. We test whether these down-sampling techniques can also improve problem-solving success in the context of three other commonly used selection methods, fitness-proportionate, tournament, implicit fitness sharing plus tournament selection, across six program synthesis GP problems. We verified that down-sampling can significantly improve the problem-solving success for all three of these other selection schemes, demonstrating its general efficacy. We discern that the selection pressure imposed by the selection scheme does not interact with the down-sampling method. However, we find that informed down-sampling can improve problem solving success significantly over random down-sampling when the selection scheme has a mechanism for diversity maintenance like lexicase or implicit fitness sharing. Overall, our results suggest that down-sampling should be considered more often when solving test-based problems, regardless of the selection scheme in use.

📄 PDF Abstract BibTeX arXiv:2304.07089

Code (0)

등록된 구현이 없습니다.

Tasks

Program SynthesisSymbolic Regression

Methods 이 논문이 사용한 방법론

Test 설명 없음

Similar Papers 제목 키워드 기반

Down-Sampled Epsilon-Lexicase Selection for Real-World Symbolic Regression Problems

2023-02-08 · Alina Geiger, Dominik Sobania, Franz Rothlauf

Epsilon-lexicase selection is a parent selection method in genetic programming that has been successfully applied to symbolic regression problems. Recently, the combination of random subsampling with lexicase selection s…

Program SynthesisregressionSymbolic Regression

A Static Analysis of Informed Down-Samples

2023-04-04 · Ryan Boldi, Alexander Lalejini, Thomas Helmuth, Lee Spector

We present an analysis of the loss of population-level test coverage induced by different down-sampling strategies when combined with lexicase selection. We study recorded populations from the first generation of genetic…

Runtime phylogenetic analysis enables extreme subsampling for test-based problems

2024-02-02 · Alexander Lalejini, Marcos Sanson, Jack Garbus, Matthew Andres Moreno 외

A phylogeny describes the evolutionary history of an evolving population. Evolutionary search algorithms can perfectly track the ancestry of candidate solutions, illuminating a population's trajectory through the search …

DiagnosticProgram Synthesis

Phylogeny-informed fitness estimation

2023-06-06 · Alexander Lalejini, Matthew Andres Moreno, Jose Guadalupe Hernandez, Emily Dolson

Phylogenies (ancestry trees) depict the evolutionary history of an evolving population. In evolutionary computing, a phylogeny can reveal how an evolutionary algorithm steers a population through a search space, illumina…

DiagnosticDiversityEvolutionary Algorithms

The Environmental Discontinuity Hypothesis for Down-Sampled Lexicase Selection

2022-05-31 · Ryan Boldi, Thomas Helmuth, Lee Spector

Down-sampling training data has long been shown to improve the generalization performance of a wide range of machine learning systems. Recently, down-sampling has proved effective in genetic programming (GP) runs that ut…

Program Synthesis