paper-with-me

홈 › Papers

Deep Recurrent Q-learning for Energy-constrained Coverage with a Mobile Robot

2022-10-01 · Aaron Zellner, Ayan Dutta, Iliya Kulbaka, Gokarna Sharma

In this paper, we study the problem of coverage of an environment with an energy-constrained robot in the presence of multiple charging stations. As the robot's on-board power supply is limited, it might not have enough energy to cover all the points in the environment with a single charge. Instead, it will need to stop at one or more charging stations to recharge its battery intermittently. The robot cannot violate the energy constraint, i.e., visit a location with negative available energy. To solve this problem, we propose a deep Q-learning framework that produces a policy to maximize the coverage and minimize the budget violations. Our proposed framework also leverages the memory of a recurrent neural network (RNN) to better suit this multi-objective optimization problem. We have tested the presented framework within a 16 x 16 grid environment having charging stations and various obstacle configurations. Results show that our proposed method finds feasible solutions and outperforms a comparable existing technique.

📄 PDF Abstract BibTeX arXiv:2210.00327

Code (0)

등록된 구현이 없습니다.

Tasks

Q-Learning

Methods 이 논문이 사용한 방법론

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Similar Papers 제목 키워드 기반

$ε^*$+: An Online Coverage Path Planning Algorithm for Energy-constrained Autonomous Vehicles

2020-08-29 · Zongyuan Shen, James P. Wilson, Shalabh Gupta

This paper presents a novel algorithm, called $\epsilon^*$+, for online coverage path planning of unknown environments using energy-constrained autonomous vehicles. Due to limited battery size, the energy-constrained veh…

Autonomous VehiclesNavigate

Coverage Path Planning: Classical Foundations, Recent Advances, and Future Directions

2026-07-12 · Zongyuan Shen, Shalabh Gupta, Shancheng Zhao, Dehua Zhou 외 arxiv

Coverage path planning (CPP) is a fundamental problem in robot motion planning, whose aim is to produce robot trajectories that provide complete coverage of target workspaces while minimizing task-specific objectives suc…

Motion Planning

Reinforcement Learning-Based Energy-Aware Coverage Path Planning for Precision Agriculture

2026-01-23 · Beining Wu, Zihao Ding, Leo Ostigaard, Jun Huang arxiv

Coverage Path Planning (CPP) is a fundamental capability for agricultural robots; however, existing solutions often overlook energy constraints, resulting in incomplete operations in large-scale or resource-limited envir…

Reinforcement Learning

Enhancing Cellular-enabled Collaborative Robots Planning through GNSS data for SAR Scenarios

2026-02-25 · Arnau Romero, Carmen Delgado, Jana Baguer, Raúl Suárez 외 arxiv

Cellular-enabled collaborative robots are becoming paramount in Search-and-Rescue (SAR) and emergency response. Crucially dependent on resilient mobile network connectivity, they serve as invaluable assets for tasks like…

Leveraging Energy Features for Surface Classification with Deep Learning: A Comparative Analysis Across Three Independent Datasets

2026-06-17 · Alexander Belyaev, Oleg Kushnarev arxiv

The energy-based method remains a comparatively underexamined approach for surface classification in mobile robotics, despite promising results in constrained environments. This study evaluated the viability of using ene…