Environmental-Impact Based Multi-Agent Reinforcement Learning

2023-11-06 · Farinaz Alamiyan-Harandi, Pouria Ramazi

To promote cooperation and strengthen the individual impact on the collective outcome in social dilemmas, we propose the Environmental-impact Multi-Agent Reinforcement Learning (EMuReL) method where each agent estimates the "environmental impact" of every other agent, that is, the difference in the current environment state compared to the hypothetical environment in the absence of that other agent. Inspired by the Inequity Aversion model, the agent then compares its own reward with those of its fellows multiplied by their environmental impacts. If its reward exceeds the scaled reward of one of its fellows, the agent takes "social responsibility" toward that fellow by reducing its own reward. Therefore, the less influential an agent is in reaching the current state, the more social responsibility is taken by other agents. Experiments in the Cleanup (resp. Harvest) test environment demonstrate that agents trained based on EMuReL learn to cooperate more effectively and obtain $54\%$ ($39\%$) and $20\%$ ($44\%$) more total rewards while preserving the same cooperation levels compared to when they are trained based on the two state-of-the-art reward reshaping methods inequity aversion and social influence.

📄 PDF Abstract BibTeX arXiv:2311.04240

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning

CropGym: a Reinforcement Learning Environment for Crop Management

2021-04-09 · Hiske Overweg, Herman N. C. Berghuijs, Ioannis N. Athanasiadis

Nitrogen fertilizers have a detrimental effect on the environment, which can be reduced by optimizing fertilizer management strategies. We implement an OpenAI Gym environment where a reinforcement learning agent can lear…

Management OpenAI Gym reinforcement-learning Reinforcement Learning+1

Autonomous AI Agents for Real-Time Affordable Housing Site Selection: Multi-Objective Reinforcement Learning Under Regulatory Constraints

2026-02-03 · Olaf Yunus Laitinen Imanov, Duygu Erisken, Derya Umut Kulali, Taner Yilmaz 외 arxiv

Affordable housing shortages affect billions, while land scarcity and regulations make site selection slow. We present AURA (Autonomous Urban Resource Allocator), a hierarchical multi-agent reinforcement learning system …

Multi-agent Reinforcement Learning

CHIRPs: Change-Induced Regret Proxy metrics for Lifelong Reinforcement Learning

2024-09-05 · John Birkbeck, Adam Sobey, Federico Cerutti, Katherine Heseltine Hurley Flynn 외

Reinforcement learning (RL) agents are costly to train and fragile to environmental changes. They often perform poorly when there are many changing tasks, prohibiting their widespread deployment in the real world. Many L…

Lifelong learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

The Synergy Between Optimal Transport Theory and Multi-Agent Reinforcement Learning

2024-01-18 · Ali Baheri, Mykel J. Kochenderfer

This paper explores the integration of optimal transport (OT) theory with multi-agent reinforcement learning (MARL). This integration uses OT to handle distributions and transportation problems to enhance the efficiency,…

Management Multi-agent Reinforcement Learning

Towards Robust Deep Reinforcement Learning against Environmental State Perturbation

2025-06-10 · Chenxu Wang, Huaping Liu

Adversarial attacks and robustness in Deep Reinforcement Learning (DRL) have been widely studied in various threat models; however, few consider environmental state perturbations, which are natural in embodied scenarios.…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning