Energy-Efficient Power Allocation and Q-Learning-Based Relay Selection for Relay-Aided D2D Communication
Device-to-device (D2D) communication is a promising paradigm to meet the requirement of ultra-dense, low-latency and high-rate in the fifth-generation networks. However, energy consumption is a critical issue for the D2D communication, especially for D2D relay networks. To make the best use of D2D communication, the problem of optimizing energy efficiency (EE) must be addressed. In this paper, we propose a joint power allocation and relay selection (JPARS) scheme for the improvement of energy efficiency in relay-aided D2D communications underlaying cellular network. A mixed integer nonlinear fractional programming (MINLP) problem of the total EE for D2D pairs is formulated. While ensuring the quality of service (QoS) of cellular users and D2D links, we solve the power allocation problem by Dinkelbach method and Lagrange dual decomposition. After that, Q-learning, one of the reinforcement learning algorithms, is employed to solve the relay selection problem. Finally, we provide in-depth theoretical analysis of the proposed scheme in terms of complexity and signaling overhead. Simulation results verify that the proposed scheme not only overcomes the bottleneck effect, but also nearly reaches the theoretical maximum in terms of the total EE of D2D pairs.
Code (0)
등록된 구현이 없습니다.
Tasks
Q-LearningSimilar Papers 제목 키워드 기반
Energy-Efficient Fixed-Gain AF Relay Assisted OFDM with Index Modulation
To broaden the application scenario and reduce energy consumption, we propose an energy-efficient fixed-gain (FG) amplify-and-forward (AF) relay assisted orthogonal frequency-division multiplexing with index modulation (…
Optimal Transmission Using a Self-sustained Relay in a Full-Duplex MIMO System
This paper investigates wireless information and power transfer in a full-duplex MIMO relay channel where the self-sustained relay harvests energy from both source transmit signal and self-interference signal to decode a…
Hierarchical Reinforcement Learning for Relay Selection and Power Optimization in Two-Hop Cooperative Relay Network
Cooperative communication is an effective approach to improve spectrum utilization. In order to reduce outage probability of communication system, most studies propose various schemes for relay selection and power alloca…
Deep Reinforcement LearningHierarchical Reinforcement Learningreinforcement-learningReinforcement Learning+1Optimizing Throughput in a MIMO System with a Self-sustained Relay and Non-uniform Power Splitting
We present a novel approach to maximizing the transmission rate in a MIMO relay system, where all nodes are equipped with multiple antennas and the relay is self-sustained by harvesting energy. We formulate an optimizati…
Energy-Efficient Buffer-Aided Relaying Systems with Opportunistic Spectrum Access
In this paper, an energy-efficient cross-layer design framework is proposed for cooperative relaying networks, which takes into account the influence of spectrum utilization probability. Specifically, random arrival traf…