paper-with-me

홈 › Papers

Deep Q-Learning for Same-Day Delivery with Vehicles and Drones

2019-10-25 · Xinwei Chen, Marlin W. Ulmer, Barrett W. Thomas

In this paper, we consider same-day delivery with vehicles and drones. Customers make delivery requests over the course of the day, and the dispatcher dynamically dispatches vehicles and drones to deliver the goods to customers before their delivery deadline. Vehicles can deliver multiple packages in one route but travel relatively slowly due to the urban traffic. Drones travel faster, but they have limited capacity and require charging or battery swaps. To exploit the different strengths of the fleets, we propose a deep Q-learning approach. Our method learns the value of assigning a new customer to either drones or vehicles as well as the option to not offer service at all. In a systematic computational analysis, we show the superiority of our policy compared to benchmark policies and the effectiveness of our deep Q-learning approach. We also show that our policy can maintain effectiveness when the fleet size changes moderately. Experiments on data drawn from varied spatial/temporal distributions demonstrate that our trained policies can cope with changes in the input data.

📄 PDF Abstract BibTeX arXiv:1910.11901

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingQ-Learning

Methods 이 논문이 사용한 방법론

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Similar Papers 제목 키워드 기반

Efficient Large-Scale Multi-Drone Delivery Using Transit Networks

2019-09-26 · Shushman Choudhury, Kiril Solovey, Mykel J. Kochenderfer, Marco Pavone

We consider the problem of controlling a large fleet of drones to deliver packages simultaneously across broad urban areas. To conserve energy, drones hop between public transit vehicles (e.g., buses and trams). We desig…

Neural Myerson Auction for Truthful and Energy-Efficient Autonomous Aerial Data Delivery

2021-12-29 · Haemin Lee, Sean Kwon, Soyi Jung, Joongheon Kim

A successful deployment of drones provides an ideal solution for surveillance systems. Using drones for surveillance can provide access to areas that may be difficult or impossible to reach by humans or in-land vehicles …

Single Particle Analysis

Effects of a Hovering Unmanned Aerial Vehicle on Urban Soundscapes Perception

2019-11-29

Several industry leaders and governmental agencies are currently investigating the use of Unmanned Aerial Vehicles (UAVs), or drones as commonly known, for an ever-growing number of applications from blue light services …

An Evolutionary Algorithm For the Vehicle Routing Problem with Drones with Interceptions

2024-09-21 · Carlos Pambo, Jacomine Grobler

The use of trucks and drones as a solution to address last-mile delivery challenges is a new and promising research direction explored in this paper. The variation of the problem where the drone can intercept the truck w…

BenchmarkingScheduling

Precise Payload Delivery via Unmanned Aerial Vehicles: An Approach Using Object Detection Algorithms

2023-10-10 · Aditya Vadduri, Anagh Benjwal, Abhishek Pai, Elkan Quadros 외

Recent years have seen tremendous advancements in the area of autonomous payload delivery via unmanned aerial vehicles, or drones. However, most of these works involve delivering the payload at a predetermined location u…

object-detectionObject Detection