DynamoRep: Trajectory-Based Population Dynamics for Classification of Black-box Optimization Problems
The application of machine learning (ML) models to the analysis of optimization algorithms requires the representation of optimization problems using numerical features. These features can be used as input for ML models that are trained to select or to configure a suitable algorithm for the problem at hand. Since in pure black-box optimization information about the problem instance can only be obtained through function evaluation, a common approach is to dedicate some function evaluations for feature extraction, e.g., using random sampling. This approach has two key downsides: (1) It reduces the budget left for the actual optimization phase, and (2) it neglects valuable information that could be obtained from a problem-solver interaction. In this paper, we propose a feature extraction method that describes the trajectories of optimization algorithms using simple descriptive statistics. We evaluate the generated features for the task of classifying problem classes from the Black Box Optimization Benchmarking (BBOB) suite. We demonstrate that the proposed DynamoRep features capture enough information to identify the problem class on which the optimization algorithm is running, achieving a mean classification accuracy of 95% across all experiments.
Code (1)
Tasks
BenchmarkingDescriptiveSimilar Papers 제목 키워드 기반
Learning Lineage-guided Geodesics with Finsler Geometry
Trajectory inference investigates how to interpolate paths between observed timepoints of dynamical systems, such as temporally resolved population distributions, with the goal of inferring trajectories at unseen times a…
Neural Lagrangian Schrödinger Bridge: Diffusion Modeling for Population Dynamics
Population dynamics is the study of temporal and spatial variation in the size of populations of organisms and is a major part of population ecology. One of the main difficulties in analyzing population dynamics is that …
Mean-Field Diffuser: Scaling Offline MARL to Thousands of Agents
Diffusion-based planning has achieved strong results in single-agent offline reinforcement learning, yet scaling to many-agent systems remains intractable due to the curse of dimensionality in the joint trajectory space.…
Reinforcement LearningTrajectory PlanningAnalysis of long-term transients and detection of early warning signs of major population changes in a two-timescale ecosystem
Identifying early warning signs of sudden population changes and mechanisms leading to regime shifts are highly desirable in population biology. In this paper, a two-trophic ecosystem comprising of two species of predato…
FormDICE: Discrete inverse continuity equation for learning population dynamics
We introduce the Discrete Inverse Continuity Equation (DICE) method, a generative modeling approach that learns the evolution of a stochastic process from given sample populations at a finite number of time points. Model…