paper-with-me

Papers

Learning to reset in target search problems

2025-03-14 · Gorka Muñoz-Gil, Hans J. Briegel, Michele Caraglio

Target search problems are central to a wide range of fields, from biological foraging to the optimization algorithms. Recently, the ability to reset the search has been shown to significantly improve the searcher's efficiency. However, the optimal resetting strategy depends on the specific properties of the search problem and can often be challenging to determine. In this work, we propose a reinforcement learning (RL)-based framework to train agents capable of optimizing their search efficiency in environments by learning how to reset. First, we validate the approach in a well-established benchmark: the Brownian search with resetting. There, RL agents consistently recover strategies closely resembling the sharp resetting distribution, known to be optimal in this scenario. We then extend the framework by allowing agents to control not only when to reset, but also their spatial dynamics through turning actions. In this more complex setting, the agents discover strategies that adapt both resetting and turning to the properties of the environment, outperforming the proposed benchmarks. These results demonstrate how reinforcement learning can serve both as an optimization tool and a mechanism for uncovering new, interpretable strategies in stochastic search processes with resetting.

📄 PDF Abstract BibTeX arXiv:2503.11330

Code (1)

gorkamunoz/rl_opts

Tasks

reinforcement-learningReinforcement LearningReinforcement Learning (RL)

Similar Papers 제목 키워드 기반

AutoCoreset: An Automatic Practical Coreset Construction Framework

2023-05-19 · Alaa Maalouf, Murad Tukan, Vladimir Braverman, Daniela Rus

A coreset is a tiny weighted subset of an input set, that closely resembles the loss function, with respect to a certain set of queries. Coresets became prevalent in machine learning as they have shown to be advantageous…

Correct-by-Construction for Hybrid Systems by Synthesizing Reset Controller

2023-09-12 · Jiang Liu, Han Su, Yunjun Bai, Bin Gu 외

Controller synthesis, including reset controller, feedback controller, and switching logic controller, provides an essential mechanism to guarantee the correctness and reliability of hybrid systems in a correct-by-constr…

Coresets for Wasserstein Distributionally Robust Optimization Problems

2022-10-09 · Ruomin Huang, Jiawei Huang, Wenjie Liu, Hu Ding

Wasserstein distributionally robust optimization (\textsf{WDRO}) is a popular model to enhance the robustness of machine learning with ambiguous data. However, the complexity of \textsf{WDRO} can be prohibitive in practi…

Universal Weak Coreset

2023-05-26 · Ragesh Jaiswal, Amit Kumar

Coresets for $k$-means and $k$-median problems yield a small summary of the data, which preserve the clustering cost with respect to any set of $k$ centers. Recently coresets have also been constructed for constrained $k…

ClusteringConstrained ClusteringData Compression

Robust Coreset Construction for Distributed Machine Learning

2019-04-11 · Hanlin Lu, Ming-Ju Li, Ting He, Shiqiang Wang 외

Coreset, which is a summary of the original dataset in the form of a small weighted set in the same sample space, provides a promising approach to enable machine learning over distributed data. Although viewed as a proxy…

BIG-bench Machine LearningClustering