paper-with-me

Papers

Training Greedy Policy for Proposal Batch Selection in Expensive Multi-Objective Combinatorial Optimization

2024-06-21 · Deokjae Lee, Hyun Oh Song, Kyunghyun Cho

Active learning is increasingly adopted for expensive multi-objective combinatorial optimization problems, but it involves a challenging subset selection problem, optimizing the batch acquisition score that quantifies the goodness of a batch for evaluation. Due to the excessively large search space of the subset selection problem, prior methods optimize the batch acquisition on the latent space, which has discrepancies with the actual space, or optimize individual acquisition scores without considering the dependencies among candidates in a batch instead of directly optimizing the batch acquisition. To manage the vast search space, a simple and effective approach is the greedy method, which decomposes the problem into smaller subproblems, yet it has difficulty in parallelization since each subproblem depends on the outcome from the previous ones. To this end, we introduce a novel greedy-style subset selection algorithm that optimizes batch acquisition directly on the combinatorial space by sequential greedy sampling from the greedy policy, specifically trained to address all greedy subproblems concurrently. Notably, our experiments on the red fluorescent proteins design task show that our proposed method achieves the baseline performance in 1.69x fewer queries, demonstrating its efficiency.

📄 PDF Abstract BibTeX arXiv:2406.14876

Code (1)

snu-mllab/greedypolicyformoco 공식 구현 pytorch

Tasks

Active LearningCombinatorial Optimization

Similar Papers 제목 키워드 기반

Fitted Q-iteration in continuous action-space MDPs

2007-12-01 · NeurIPS 2007 12 · András Antos, Csaba Szepesvári, Rémi Munos

We consider continuous state, continuous action batch reinforcement learning where the goal is to learn a good policy from a sufficiently rich trajectory generated by another policy. We study a variant of fitted Q-iterat…

reinforcement-learningReinforcement LearningReinforcement Learning (RL)

Submodular Batch Selection for Training Deep Neural Networks

2019-06-20 · K J Joseph, Vamshi Teja R, Krishnakant Singh, Vineeth N. Balasubramanian

Mini-batch gradient descent based methods are the de facto algorithms for training neural network architectures today. We introduce a mini-batch selection strategy based on submodular function maximization. Our novel sub…

Combinatorial OptimizationDiversityInformativeness

CLIPPER: Replayable Shortlisted Optimization for Repeated Spatial Coverage Planning

2026-08-27 · Julian Teusch, Jörg Philipp Müller, Monika Sester arxiv

Operational requirements developed with the City of Braunschweig frame municipal micromobility planning under geofenced exclusions, mandatory retained sites, spacing rules, and area-level caps. Each policy edit requires …

Active Learning via Classifier Impact and Greedy Selection for Interactive Image Retrieval

2024-12-03 · Leah Bar, Boaz Lerner, Nir Darshan, Rami Ben-Ari

Active Learning (AL) is a user-interactive approach aimed at reducing annotation costs by selecting the most crucial examples to label. Although AL has been extensively studied for image classification tasks, the specifi…

Active LearningBinary ClassificationContent-Based Image Retrievalimage-classification+3

Slim Scheduler: A Runtime-Aware RL and Scheduler System for Efficient CNN Inference

2025-10-10 · Ian Harshbarger, Calvin Chidambaram arxiv

Most neural network scheduling research focuses on optimizing static, end-to-end models of fixed width, overlooking dynamic approaches that adapt to heterogeneous hardware and fluctuating runtime conditions. We present S…

Reinforcement Learning