Double Deep Q-Learning in Opponent Modeling
Multi-agent systems in which secondary agents with conflicting agendas also alter their methods need opponent modeling. In this study, we simulate the main agent's and secondary agents' tactics using Double Deep Q-Networks (DDQN) with a prioritized experience replay mechanism. Then, under the opponent modeling setup, a Mixture-of-Experts architecture is used to identify various opponent strategy patterns. Finally, we analyze our models in two environments with several agents. The findings indicate that the Mixture-of-Experts model, which is based on opponent modeling, performs better than DDQN.
Code (0)
등록된 구현이 없습니다.
Tasks
Mixture-of-ExpertsQ-LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Double opponency serves as a basis for color constancy
Color constancy (CC) is one of the important perceptual abilities of the human visual system, which states that despite changes in illumination, the perceived colors of surfaces generally tend to remain constant. Neverth…
Color ConstancyLearning Tennis Strategy Through Curriculum-Based Dueling Double Deep Q-Networks
Tennis strategy optimization is a challenging sequential decision-making problem involving hierarchical scoring, stochastic outcomes, long-horizon credit assignment, physical fatigue, and adaptation to opponent skill. I …
Reinforcement LearningL2E: Learning to Exploit Your Opponent
Opponent modeling is essential to exploit sub-optimal opponents in strategic interactions. Most previous works focus on building explicit models to directly predict the opponents' styles or strategies, which require a la…
Model-Based Opponent Modeling
When one agent interacts with a multi-agent environment, it is challenging to deal with various opponents unseen before. Modeling the behaviors, goals, or beliefs of opponents could help the agent adjust its policy to ad…
modelVariational Autoencoders for Opponent Modeling in Multi-Agent Systems
Multi-agent systems exhibit complex behaviors that emanate from the interactions of multiple agents in a shared environment. In this work, we are interested in controlling one agent in a multi-agent system and successful…
Reinforcement Learning