Learning-based Autonomous Channel Access in the Presence of Hidden Terminals
We consider the problem of autonomous channel access (AutoCA), where a group of terminals tries to discover a communication strategy with an access point (AP) via a common wireless channel in a distributed fashion. Due to the irregular topology and the limited communication range of terminals, a practical challenge for AutoCA is the hidden terminal problem, which is notorious in wireless networks for deteriorating the throughput and delay performances. To meet the challenge, this paper presents a new multi-agent deep reinforcement learning paradigm, dubbed MADRL-HT, tailored for AutoCA in the presence of hidden terminals. MADRL-HT exploits topological insights and transforms the observation space of each terminal into a scalable form independent of the number of terminals. To compensate for the partial observability, we put forth a look-back mechanism such that the terminals can infer behaviors of their hidden terminals from the carrier sensed channel states as well as feedback from the AP. A window-based global reward function is proposed, whereby the terminals are instructed to maximize the system throughput while balancing the terminals' transmission opportunities over the course of learning. Extensive numerical experiments verified the superior performance of our solution benchmarked against the legacy carrier-sense multiple access with collision avoidance (CSMA/CA) protocol.
Code (0)
등록된 구현이 없습니다.
Tasks
Collision AvoidanceDeep Reinforcement LearningSimilar Papers 제목 키워드 기반
Massive Wireless Energy Transfer with Statistical CSI Beamforming
Wireless energy transfer (WET) is a promising solution to enable massive machine-type communications (mMTC) with low-complexity and low-powered wireless devices. Given the energy restrictions of the devices, instant chan…
FairnessCross-layer Interference Modeling for 5G MmWave Networks in the Presence of Blockage
Fifth generation (5G) wireless technology is expected to utilize highly directive antennas at millimeter wave (mmWave) spectrum to offer higher data rates. However, given the high directivity of antennas and adverse prop…
Distributed Policy Learning Based Random Access for Diversified QoS Requirements
Future wireless access networks need to support diversified quality of service (QoS) metrics required by various types of Internet-of-Things (IoT) devices, e.g., age of information (AoI) for status generating sources and…
Positioning-Aided Channel Estimation for Multi-LEO Satellite Cooperative Communications
We investigate a multi-low Earth orbit (LEO) satellite system that simultaneously provides positioning and communication services to terrestrial user terminals. To address the challenges of channel estimation in LEO sate…
PositionCoordinates-based Resource Allocation Through Supervised Machine Learning
Appropriate allocation of system resources is essential for meeting the increased user-traffic demands in the next generation wireless technologies. Traditionally, the system relies on channel state information (CSI) of …
BIG-bench Machine Learning