paper-with-me

홈 › Papers

Balancing Specialization and Centralization: A Multi-Agent Reinforcement Learning Benchmark for Sequential Industrial Control

2025-10-23 · Tom Maus, Asma Atamna, Tobias Glasmachers arxiv

Autonomous control of multi-stage industrial processes requires both local specialization and global coordination. Reinforcement learning (RL) offers a promising approach, but its industrial adoption remains limited due to challenges such as reward design, modularity, and action space management. Many academic benchmarks differ markedly from industrial control problems, limiting their transferability to real-world applications. This study introduces an enhanced industry-inspired benchmark environment that combines tasks from two existing benchmarks, SortingEnv and ContainerGym, into a sequential recycling scenario with sorting and pressing operations. We evaluate two control strategies: a modular architecture with specialized agents and a monolithic agent governing the full system, while also analyzing the impact of action masking. Our experiments show that without action masking, agents struggle to learn effective policies, with the modular architecture performing better. When action masking is applied, both architectures improve substantially, and the performance gap narrows considerably. These results highlight the decisive role of action space constraints and suggest that the advantages of specialization diminish as action complexity is reduced. The proposed benchmark thus provides a valuable testbed for exploring practical and robust multi-agent RL solutions in industrial automation, while contributing to the ongoing debate on centralization versus specialization.

📄 PDF Abstract BibTeX arXiv:2510.20408

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-agent Reinforcement Learning

Similar Papers 제목 키워드 기반

An Analysis of Multi-Agent Reinforcement Learning for Decentralized Inventory Control Systems

2023-07-21 · Marwan Mousa, Damien van de Berg, Niki Kotecha, Ehecatl Antonio del Rio-Chanona 외

Most solutions to the inventory management problem assume a centralization of information that is incompatible with organisational constraints in real supply chain networks. The inventory management problem is a well-kno…

ManagementMulti-agent Reinforcement Learningreinforcement-learning

EmoAgent-R1: Towards Multimodal Emotion Understanding with Reinforcement Learning-based Dynamic Agent Specialization

2026-07-23 · Lihuang Fang, Yuchen Zou, kebin Jin, Jinghui Qin arxiv

Multimodal large language models (MLLMs) have achieved impressive performance in multimodal emotion recognition (MER) tasks and lifted MER to a new level that is complex emotion understanding with advanced video understa…

Multimodal Emotion RecognitionReinforcement Learning

Evaluating Generalization and Transfer Capacity of Multi-Agent Reinforcement Learning Across Variable Number of Agents

2021-11-28 · Bengisu Guresti, Nazim Kemal Ure

Multi-agent Reinforcement Learning (MARL) problems often require cooperation among agents in order to solve a task. Centralization and decentralization are two approaches used for cooperation in MARL. While fully decentr…

Multi-agent Reinforcement Learning

Parental Guidance: Efficient Lifelong Learning through Evolutionary Distillation

2025-03-24 · Octi Zhang, Quanquan Peng, Rosario Scalise, Bryon Boots

Developing robotic agents that can perform well in diverse environments while showing a variety of behaviors is a key challenge in AI and robotics. Traditional reinforcement learning (RL) methods often create agents that…

Continual LearningDiversityImitation LearningLifelong learning+1

Deep Implicit Coordination Graphs for Multi-agent Reinforcement Learning

2020-06-19 · Sheng Li, Jayesh K. Gupta, Peter Morales, Ross Allen 외

Multi-agent reinforcement learning (MARL) requires coordination to efficiently solve certain tasks. Fully centralized control is often infeasible in such domains due to the size of joint action spaces. Coordination graph…

Graph Neural NetworkMulti-agent Reinforcement Learningreinforcement-learningReinforcement Learning+5