Sample-Efficient Optimization in the Latent Space of Deep Generative Models via Weighted Retraining
Many important problems in science and engineering, such as drug design, involve optimizing an expensive black-box objective function over a complex, high-dimensional, and structured input space. Although machine learning techniques have shown promise in solving such problems, existing approaches substantially lack sample efficiency. We introduce an improved method for efficient black-box optimization, which performs the optimization in the low-dimensional, continuous latent manifold learned by a deep generative model. In contrast to previous approaches, we actively steer the generative model to maintain a latent manifold that is highly useful for efficiently optimizing the objective. We achieve this by periodically retraining the generative model on the data points queried along the optimization trajectory, as well as weighting those data points according to their objective function value. This weighted retraining can be easily implemented on top of existing methods, and is empirically shown to significantly improve their efficiency and performance on synthetic and real-world optimization problems.
Code (1)
Tasks
Drug DesignMolecular Graph GenerationSimilar Papers 제목 키워드 기반
Happy People -- Image Synthesis as Black-Box Optimization Problem in the Discrete Latent Space of Deep Generative Models
In recent years, optimization in the learned latent space of deep generative models has been successfully applied to black-box optimization problems such as drug design, image generation or neural architecture search. Ex…
Drug DesignImage GenerationNeural Architecture SearchMulti-Objective Latent Space Optimization of Generative Molecular Design Models
Molecular design based on generative models, such as variational autoencoders (VAEs), has become increasingly popular in recent years due to its efficiency for exploring high-dimensional molecular space to identify molec…
HelixMO: Sample-Efficient Molecular Optimization in Scene-Sensitive Latent Space
Efficient exploration of the chemical space to search the candidate drugs that satisfy various constraints is a fundamental task of drug discovery. Advanced deep generative methods attempt to optimize the molecules in th…
Drug DesignDrug DiscoveryEfficient ExplorationGenerative Latent Implicit Conditional Optimization when Learning from Small Sample
We revisit the long-standing problem of learning from a small sample, to which end we propose a novel method called GLICO (Generative Latent Implicit Conditional Optimization). GLICO learns a mapping from the training ex…
Conditional Image GenerationData Augmentationimage-classificationImage Classification+1Score-Guided Intermediate Layer Optimization: Fast Langevin Mixing for Inverse Problems
We prove fast mixing and characterize the stationary distribution of the Langevin Algorithm for inverting random weighted DNN generators. This result extends the work of Hand and Voroninski from efficient inversion to ef…