paper-with-me

Papers

Shared learning of powertrain control policies for vehicle fleets

2024-04-27 · Lindsey Kerbel, Beshah Ayalew, Andrej Ivanco

Emerging data-driven approaches, such as deep reinforcement learning (DRL), aim at on-the-field learning of powertrain control policies that optimize fuel economy and other performance metrics. Indeed, they have shown great potential in this regard for individual vehicles on specific routes or drive cycles. However, for fleets of vehicles that must service a distribution of routes, DRL approaches struggle with learning stability issues that result in high variances and challenge their practical deployment. In this paper, we present a novel framework for shared learning among a fleet of vehicles through the use of a distilled group policy as the knowledge sharing mechanism for the policy learning computations at each vehicle. We detail the mathematical formulation that makes this possible. Several scenarios are considered to analyze the functionality, performance, and computational scalability of the framework with fleet size. Comparisons of the cumulative performance of fleets using our proposed shared learning approach with a baseline of individual learning agents and another state-of-the-art approach with a centralized learner show clear advantages to our approach. For example, we find a fleet average asymptotic improvement of 8.5 percent in fuel economy compared to the baseline while also improving on the metrics of acceleration error and shifting frequency for fleets serving a distribution of suburban routes. Furthermore, we include demonstrative results that show how the framework reduces variance within a fleet and also how it helps individual agents adapt better to new routes.

📄 PDF Abstract BibTeX arXiv:2404.17892

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learning

Methods 이 논문이 사용한 방법론

Golden Queue Managers 설명 없음

Similar Papers 제목 키워드 기반

Optimal control barrier functions for RL based safe powertrain control

2024-05-18 · Habtamu Hailemichael, Beshah Ayalew, Andrej Ivanco

Reinforcement learning (RL) can improve control performance by seeking to learn optimal control policies in the end-use environment for vehicles and other systems. To accomplish this, RL algorithms need to sufficiently e…

Reinforcement Learning (RL)

Optimization of Power Control for Autonomous Hybrid Electric Vehicles with Flexible Power Demand

2023-12-13 · Mohammadali Kargar, Xingyong Song

Technology advancement for on-road vehicles has gained significant momentum in the past decades, particularly in the field of vehicle automation and powertrain electrification. The optimization of powertrain controls for…

Autonomous Vehicles

Electric Autonomous Mobility-on-Demand: Joint Optimization of Routing and Charging Infrastructure Siting

2022-11-22 · Fabio Paparella, Karni Chauhan, Theo Hofman, Mauro Salazar

The advent of vehicle autonomy, connectivity and electric powertrains is expected to enable the deployment of Autonomous Mobility-on-Demand systems. Crucially, the routing and charging activities of these fleets are impa…

Co-optimization of Vehicle Dynamics and Powertrain Management for Connected and Automated Electric Vehicles

2024-12-19 · ZongTan Li, Yunli Shao

Connected and automated vehicles (CAVs) represent the future of transportation, utilizing detailed traffic information to enhance control and decision-making. Eco-driving of CAVs has the potential to significantly improv…

Management

Residual Policy Learning for Powertrain Control

2022-12-15 · Lindsey Kerbel, Beshah Ayalew, Andrej Ivanco, Keith Loiselle

Eco-driving strategies have been shown to provide significant reductions in fuel consumption. This paper outlines an active driver assistance approach that uses a residual policy learning (RPL) agent trained to provide r…

Reinforcement Learning (RL)