paper-with-me

홈 › Papers

A Two-stage Reinforcement Learning-based Approach for Multi-entity Task Allocation

2024-06-29 · Aicheng Gong, Kai Yang, Jiafei Lyu, Xiu Li

Task allocation is a key combinatorial optimization problem, crucial for modern applications such as multi-robot cooperation and resource scheduling. Decision makers must allocate entities to tasks reasonably across different scenarios. However, traditional methods assume static attributes and numbers of tasks and entities, often relying on dynamic programming and heuristic algorithms for solutions. In reality, task allocation resembles Markov decision processes, with dynamically changing task and entity attributes. Thus, algorithms must dynamically allocate tasks based on their states. To address this issue, we propose a two-stage task allocation algorithm based on similarity, utilizing reinforcement learning to learn allocation strategies. The proposed pre-assign strategy allows entities to preselect appropriate tasks, effectively avoiding local optima and thereby better finding the optimal allocation. We also introduce an attention mechanism and a hyperparameter network structure to adapt to the changing number and attributes of entities and tasks, enabling our network structure to generalize to new tasks. Experimental results across multiple environments demonstrate that our algorithm effectively addresses the challenges of dynamic task allocation in practical applications. Compared to heuristic algorithms like genetic algorithms, our reinforcement learning approach better solves dynamic allocation problems and achieves zero-shot generalization to new tasks with good performance. The code is available at https://github.com/yk7333/TaskAllocation.

📄 PDF Abstract BibTeX arXiv:2407.00496

Code (1)

yk7333/taskallocation 공식 구현 pytorch

Tasks

Combinatorial Optimizationreinforcement-learningReinforcement LearningSchedulingZero-shot Generalization

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

RPAF: A Reinforcement Prediction-Allocation Framework for Cache Allocation in Large-Scale Recommender Systems

2024-09-20 · Shuo Su, Xiaoshuang Chen, Yao Wang, Yulin Wu 외

Modern recommender systems are built upon computation-intensive infrastructure, and it is challenging to perform real-time computation for each request, especially in peak periods, due to the limited computational resour…

Recommendation Systems

MaRCA: Multi-Agent Reinforcement Learning for Dynamic Computation Allocation in Large-Scale Recommender Systems

2025-12-30 · Wan Jiang, Xinyi Zang, Yudong Zhao, Yusi Zou 외 arxiv

Modern recommender systems face significant computational challenges due to growing model complexity and traffic scale, making efficient computation allocation critical for maximizing business revenue. Existing approache…

Multi-agent Reinforcement Learning

Autoregressive Policy Optimization for Constrained Allocation Tasks

2024-09-27 · David Winkel, Niklas Strauß, Maximilian Bernhard, Zongyue Li 외

Allocation tasks represent a class of problems where a limited amount of resources must be allocated to a set of entities at each time step. Prominent examples of this task include portfolio optimization or distributing …

Portfolio Optimization

Phase-Adaptive LLM Framework with Multi-Stage Validation for Construction Robot Task Allocation: A Systematic Benchmark Against Traditional Optimization Algorithms

2025-12-02 · Shyam prasad reddy Kaitha, Hongrui Yu arxiv

Multi-robot task allocation in construction automation has traditionally relied on optimization methods such as Dynamic Programming and Reinforcement Learning. This research introduces the LangGraph-based Task Allocation…

Reinforcement Learning

HGFormer: A Hierarchical Graph Transformer Framework for Two-Stage Colonel Blotto Games via Reinforcement Learning

2025-06-10 · Yang Lv, Jinlong Lei, Peng Yi

Two-stage Colonel Blotto game represents a typical adversarial resource allocation problem, in which two opposing agents sequentially allocate resources in a network topology across two phases: an initial resource deploy…

Decision MakingGraph Neural Network