paper-with-me

홈 › Papers

Data-Driven Strategies for Hierarchical Predictive Control in Unknown Environments

2021-05-13 · Charlott Vallon, Francesco Borrelli

This article proposes a hierarchical learning architecture for safe data-driven control in unknown environments. We consider a constrained nonlinear dynamical system and assume the availability of state-input trajectories solving control tasks in different environments. In addition to task-invariant system state and input constraints, a parameterized environment model generates task-specific state constraints, which are satisfied by the stored trajectories. Our goal is to use these trajectories to find a safe and high-performing policy for a new task in a new, unknown environment. We propose using the stored data to learn generalizable control strategies. At each time step, based on a local forecast of the new task environment, the learned strategy consists of a target region in the state space and input constraints to guide the system evolution to the target region. These target regions are used as terminal sets by a low-level model predictive controller. We show how to i) design the target sets from past data and then ii) incorporate them into a model predictive control scheme with shifting horizon that ensures safety of the closed-loop system when performing the new task. We prove the feasibility of the resulting control policy, and apply the proposed method to robotic path planning, racing, and computer game applications.

📄 PDF Abstract BibTeX arXiv:2105.06005

Code (0)

등록된 구현이 없습니다.

Tasks

Model Predictive Control

Similar Papers 제목 키워드 기반

Learning-based hierarchical control of water reservoir systems

2020-12-24 · Pauline Kergus, Simone Formentin, Matteo Giuliani, Andrea Castelletti

The optimal control of a water reservoir systems represents a challenging problem, due to uncertain hydrologic inputs and the need to adapt to changing environment and varying control objectives. In this work, we propose…

Hierarchical RL-MPC for Demand Response Scheduling

2025-02-19 · Maximilian Bloor, Ehecatl Antonio del Rio Chanona, Calvin Tsay

This paper presents a hierarchical framework for demand response optimization in air separation units (ASUs) that combines reinforcement learning (RL) with linear model predictive control (LMPC). We investigate two contr…

Model Predictive ControlReinforcement Learning (RL)Scheduling

Predictive reinforcement learning based adaptive PID controller

2025-06-10 · Chaoqun Ma, Zhiyong Zhang

Purpose: This study aims to address the challenges of controlling unstable and nonlinear systems by proposing an adaptive PID controller based on predictive reinforcement learning (PRL-PID), where the PRL-PID combines th…

reinforcement-learningReinforcement Learning

Robust Data-EnablEd Predictive Leading Cruise Control via Reachability Analysis

2024-02-06 · Shuai Li, Chaoyi Chen, Haotian Zheng, Jiawei Wang 외

Data-driven predictive control promises model-free wave-dampening strategies for Connected and Autonomous Vehicles (CAVs) in mixed traffic flow. However, its performance relies on data quality, which suffers from unknown…

Autonomous VehiclesLEMMA

Data-Driven Predictive Control for Connected and Autonomous Vehicles in Mixed Traffic

2021-10-19 · Jiawei Wang, Yang Zheng, Qing Xu, Keqiang Li

Cooperative control of Connected and Autonomous Vehicles (CAVs) promises great benefits for mixed traffic. Most existing research focuses on model-based control strategies, assuming that car-following dynamics of human-d…

Autonomous Vehicles