paper-with-me

Papers

Leveraging Discrete Function Decomposability for Scientific Design

2025-11-04 · James C. Bowden, Sergey Levine, Jennifer Listgarten arxiv

In the era of AI-driven science and engineering, we often want to design discrete objects in silico according to user-specified properties. For example, we may wish to design a protein to bind its target, arrange components within a circuit to minimize latency, or find materials with certain properties. Given a property predictive model, in silico design typically involves training a generative model over the design space (e.g., protein sequence space) to concentrate on designs with the desired properties. Distributional optimization$\unicode{x2013}$which can be formalized as an estimation of distribution algorithm or as reinforcement learning policy optimization$\unicode{x2013}$finds the generative model that maximizes an objective function in expectation. Optimizing a distribution over discrete-valued designs is in general challenging because of the combinatorial nature of the design space. However, many property predictors in scientific applications are decomposable in the sense that they can be factorized over design variables in a way that could in principle enable more effective optimization. For example, amino acids at a catalytic site of a protein may only loosely interact with amino acids of the rest of the protein to achieve maximal catalytic activity. Current distributional optimization algorithms are unable to make use of such decomposability structure. Herein, we propose and demonstrate use of a new distributional optimization algorithm, Decomposition-Aware Distributional Optimization (DADO), that can leverage any decomposability defined by a junction tree on the design variables, to make optimization more efficient. At its core, DADO employs a soft-factorized "search distribution"$\unicode{x2013}$a learned generative model$\unicode{x2013}$for efficient navigation of the search space, invoking graph message-passing to coordinate optimization across linked factors.

📄 PDF Abstract BibTeX arXiv:2511.03032

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning

Similar Papers 제목 키워드 기반

Coordination Control of Discrete Event Systems under Cyber Attacks

2023-09-21 · Fei Wang, Jan Komenda, Feng Lin

In this paper, coordination control of discrete event systems under joint sensor and actuator attacks is investigated. Sensor attacks are described by a set of attack languages using a proposed ALTER model. Several local…

Limits of Semistatic Trading Strategies

2022-04-26 · Marcel Nutz, Johannes Wiesel, Long Zhao

We show that pointwise limits of semistatic trading strategies in discrete time are again semistatic strategies. The analysis is carried out in full generality for a two-period model, and under a probabilistic condition …

CrystalBox: Future-Based Explanations for Input-Driven Deep RL Systems

2023-02-27 · Sagar Patel, Sangeetha Abdu Jyothi, Nina Narodytska

We present CrystalBox, a novel, model-agnostic, posthoc explainability framework for Deep Reinforcement Learning (DRL) controllers in the large family of input-driven environments which includes computer systems. We comb…

continuous-controlContinuous ControlDecision MakingDeep Reinforcement Learning

Reflection methods for user-friendly submodular optimization

2013-11-18 · NeurIPS 2013 12 · Stefanie Jegelka, Francis Bach, Suvrit Sra

Recently, it has become evident that submodularity naturally captures widely occurring concepts in machine learning, signal processing and computer vision. Consequently, there is need for efficient optimization procedure…

Image SegmentationSemantic Segmentation

Robust and Decomposable Average Precision for Image Retrieval

2021-10-01 · NeurIPS 2021 12 · Elias Ramzi, Nicolas Thome, Clément Rambour, Nicolas Audebert 외

In image retrieval, standard evaluation metrics rely on score ranking, e.g. average precision (AP). In this paper, we introduce a method for robust and decomposable average precision (ROADMAP) addressing two major challe…

Image RetrievalMetric LearningRetrieval