Reinforcement Learning-Enabled Reliable Wireless Sensor Networks in Dynamic Underground Environments

2019-10-26

Wireless underground sensor networks play an important role in underground sensing such as climate-smart agriculture and underground infrastructure monitoring. Existing works consider a static underground environment, which is not practical since the dielectric parameters of soil change frequently due to precipitation and harsh weather. This challenge cannot be ignored in real implementation due to the drastic change of wireless underground channel. In this paper, we study the effect of dynamic underground environment on wireless communications for sensor networks. We use the real data collected by in-situ sensors to train a Hidden Markov Model. Then, by using reinforcement learning, we derive the optimal transmission policies for underground sensors to efficiently use their energy and reduce the number of dropped and unsuccessfully transmitted packets. Through simulations using real data, we find that the developed algorithm can reduce the packet loss and transmit the sensed data in a timely manner.

📄 PDF Abstract BibTeX arXiv:1908.05804

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learning Reinforcement Learning (RL)

Learning-based sensing and computing decision for data freshness in edge computing-enabled networks

2024-01-25 · Sinwoong Yun, Dongsun Kim, Chanwon Park, Jemin Lee

As the demand on artificial intelligence (AI)-based applications increases, the freshness of sensed data becomes crucial in the wireless sensor networks. Since those applications require a large amount of computation for…

Edge-computing Reinforcement Learning (RL)

A Deep Reinforcement Learning-based Adaptive Charging Policy for Wireless Rechargeable Sensor Networks

2022-08-16 · Ngoc Bui, Phi Le Nguyen, Viet Anh Nguyen, Phan Thuan Do

Wireless sensor networks consist of randomly distributed sensor nodes for monitoring targets or areas of interest. Maintaining the network for continuous surveillance is a challenge due to the limited battery capacity in…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Sensor Fusion for Robot Control through Deep Reinforcement Learning

2017-03-13 · Steven Bohez, Tim Verbelen, Elias De Coninck, Bert Vankeirsbilck 외

Deep reinforcement learning is becoming increasingly popular for robot control algorithms, with the aim for a robot to self-learn useful feature representations from unstructured sensory input leading to the optimal actu…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

Secure Deep Reinforcement Learning for Dynamic Resource Allocation in Wireless MEC Networks

2023-12-13 · Xin Hao, Phee Lep Yeoh, Changyang She, Branka Vucetic 외

This paper proposes a blockchain-secured deep reinforcement learning (BC-DRL) optimization framework for {data management and} resource allocation in decentralized {wireless mobile edge computing (MEC)} networks. In our …

Deep Reinforcement Learning Edge-computing Management

Intelligent Communication Planning for Constrained Environmental IoT Sensing with Reinforcement Learning

2023-08-19 · Yi Hu, Jinhang Zuo, Bob Iannucci, Carlee Joe-Wong

Internet of Things (IoT) technologies have enabled numerous data-driven mobile applications and have the potential to significantly improve environmental monitoring and hazard warnings through the deployment of a network…

Intelligent Communication Multi-agent Reinforcement Learning reinforcement-learning