paper-with-me

홈 › Papers

Denoising Opponents Position in Partial Observation Environment

2023-10-23 · Aref Sayareh, Aria Sardari, Vahid Khoddami, Nader Zare, Vinicius Prado da Fonseca, Amilcar Soares

The RoboCup competitions hold various leagues, and the Soccer Simulation 2D League is a major among them. Soccer Simulation 2D (SS2D) match involves two teams, including 11 players and a coach for each team, competing against each other. The players can only communicate with the Soccer Simulation Server during the game. Several code bases are released publicly to simplify team development. So researchers can easily focus on decision-making and implementing machine learning methods. SS2D actions and behaviors are only partially accurate due to different challenges, such as noise and partial observation. Therefore, one strategy is to implement alternative denoising methods to tackle observation inaccuracy. Our idea is to predict opponent positions while they have yet to be seen in a finite number of cycles using machine learning methods to make more accurate actions such as pass. We will explain our position prediction idea powered by Long Short-Term Memory models (LSTM) and Deep Neural Networks (DNN). The results show that the LSTM and DNN predict the opponents' position more accurately than the standard algorithm, such as the last-seen method.

📄 PDF Abstract BibTeX arXiv:2310.14553

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingDenoisingPosition

Methods 이 논문이 사용한 방법론

Tanh Activation 설명 없음
Sigmoid Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…
Focus 설명 없음

Similar Papers 제목 키워드 기반

BVR Sim: An Open and High-Throughput Environment for Heterogeneous Air-Combat Reinforcement Learning

2026-08-26 · Haocheng Sun, Mulai Tan arxiv

Beyond-visual-range (BVR) air combat is a challenging reinforcement-learning domain characterized by partial observability, long-horizon decision making, energy management, and limited weapons. We present BVR Sim, an ope…

Reinforcement LearningDecision Making

Generalizable Agent Modeling for Agent Collaboration-Competition Adaptation with Multi-Retrieval and Dynamic Generation

2025-06-20 · Chenxu Wang, Yonggang Jin, Cheng Hu, Youpeng Zhao 외

Adapting a single agent to a new multi-agent system brings challenges, necessitating adjustments across various tasks, environments, and interactions with unknown teammates and opponents. Addressing this challenge is hig…

Multi-agent Reinforcement LearningSMACSMAC+Zero-Shot Learning

Observation Denoising in CYRUS Soccer Simulation 2D Team For RoboCup 2024

2024-06-09 · Nader Zare, Aref Sayareh, Sadra Khanjari, Arad Firouzkouhi

In the Soccer Simulation 2D environment, accurate observation is crucial for effective decision making. However, challenges such as partial observation and noisy data can hinder performance. To address these issues, we p…

Decision MakingDenoising

Minimax-Optimal Policy Regret in Partially Observable Markov Games

2026-06-01 · Raman Arora arxiv

We study sequential decision-making in partially observable environments against strategic, adaptive opponents, modeled as partially observable Markov games (POMGs). The central challenge is to learn latent dynamics from…

Mimicking To Dominate: Imitation Learning Strategies for Success in Multiagent Competitive Games

2023-08-20 · The Viet Bui, Tien Mai, Thanh Hong Nguyen

Training agents in multi-agent competitive games presents significant challenges due to their intricate nature. These challenges are exacerbated by dynamics influenced not only by the environment but also by opponents' s…

Imitation LearningMulti-agent Reinforcement Learning