paper-with-me

Papers

Deep Reinforcement Learning for Task Offloading in UAV-Aided Smart Farm Networks

2022-09-15 · Anne Catherine Nguyen, Turgay Pamuklu, Aisha Syed, W. Sean Kennedy, Melike Erol-Kantarci

The fifth and sixth generations of wireless communication networks are enabling tools such as internet of things devices, unmanned aerial vehicles (UAVs), and artificial intelligence, to improve the agricultural landscape using a network of devices to automatically monitor farmlands. Surveying a large area requires performing a lot of image classification tasks within a specific period of time in order to prevent damage to the farm in case of an incident, such as fire or flood. UAVs have limited energy and computing power, and may not be able to perform all of the intense image classification tasks locally and within an appropriate amount of time. Hence, it is assumed that the UAVs are able to partially offload their workload to nearby multi-access edge computing devices. The UAVs need a decision-making algorithm that will decide where the tasks will be performed, while also considering the time constraints and energy level of the other UAVs in the network. In this paper, we introduce a Deep Q-Learning (DQL) approach to solve this multi-objective problem. The proposed method is compared with Q-Learning and three heuristic baselines, and the simulation results show that our proposed DQL-based method achieves comparable results when it comes to the UAVs' remaining battery levels and percentage of deadline violations. In addition, our method is able to reach convergence 13 times faster than Q-Learning.

📄 PDF Abstract BibTeX arXiv:2209.07367

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingDeep Reinforcement LearningEdge-computingimage-classificationImage ClassificationQ-Learningreinforcement-learningReinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Similar Papers 제목 키워드 기반

Sustainable Task Offloading in Secure UAV-assisted Smart Farm Networks: A Multi-Agent DRL with Action Mask Approach

2024-07-29 · Tingnan Bao, Aisha Syed, William Sean Kennedy, Melike Erol-Kantarci

The integration of unmanned aerial vehicles (UAVs) with mobile edge computing (MEC) and Internet of Things (IoT) technology in smart farms is pivotal for efficient resource management and enhanced agricultural productivi…

Deep Reinforcement LearningEdge-computingManagement

IoT-Aerial Base Station Task Offloading with Risk-Sensitive Reinforcement Learning for Smart Agriculture

2022-09-15 · Turgay Pamuklu, Anne Catherine Nguyen, Aisha Syed, W. Sean Kennedy 외

Aerial base stations (ABSs) allow smart farms to offload processing responsibility of complex tasks from internet of things (IoT) devices to ABSs. IoT devices have limited energy and computing resources, thus it is requi…

Q-LearningReinforcement Learning (RL)Scheduling

To Risk or Not to Risk: Learning with Risk Quantification for IoT Task Offloading in UAVs

2023-02-14 · Anne Catherine Nguyen, Turgay Pamuklu, Aisha Syed, W. Sean Kennedy 외

A deep reinforcement learning technique is presented for task offloading decision-making algorithms for a multi-access edge computing (MEC) assisted unmanned aerial vehicle (UAV) network in a smart farm Internet of Thing…

Decision MakingDeep Reinforcement LearningEdge-computingFire Detection+3

Secure Computation Offloading in Blockchain based IoT Networks with Deep Reinforcement Learning

2019-08-15 · Dinh C. Nguyen, Pubudu N. Pathirana, Ming Ding, Aruna Seneviratne

For current and future Internet of Things (IoT) networks, mobile edge-cloud computation offloading (MECCO) has been regarded as a promising means to support delay-sensitive IoT applications. However, offloading mobile ta…

Deep Reinforcement LearningManagementreinforcement-learningReinforcement Learning (RL)

Hybrid UAV-enabled Secure Offloading via Deep Reinforcement Learning

2022-08-16 · Seonghoon Yoo, Seongah Jeong, Joonhyuk Kang

Unmanned aerial vehicles (UAVs) have been actively studied as moving cloudlets to provide application offloading opportunities and to enhance the security level of user equipments (UEs). In this correspondence, we propos…

Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)