Sparsity in Partially Controllable Linear Systems
A fundamental concept in control theory is that of controllability, where any system state can be reached through an appropriate choice of control inputs. Indeed, a large body of classical and modern approaches are designed for controllable linear dynamical systems. However, in practice, we often encounter systems in which a large set of state variables evolve exogenously and independently of the control inputs; such systems are only partially controllable. The focus of this work is on a large class of partially controllable linear dynamical systems, specified by an underlying sparsity pattern. Our main results establish structural conditions and finite-sample guarantees for learning to control such systems. In particular, our structural results characterize those state variables which are irrelevant for optimal control, an analysis which departs from classical control techniques. Our algorithmic results adapt techniques from high-dimensional statistics -- specifically soft-thresholding and semiparametric least-squares -- to exploit the underlying sparsity pattern in order to obtain finite-sample guarantees that significantly improve over those based on certainty-equivalence. We also corroborate these theoretical improvements over certainty-equivalent control through a simulation study.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Sparse Linear Ensemble Systems and Structural Controllability
The paper introduces and solves a structural controllability problem for continuum ensembles of linear time-invariant systems. All the individual linear systems of an ensemble are sparse, governed by the same sparsity pa…
Learning Partially Observed Linear Dynamical Systems from Logarithmic Number of Samples
In this work, we study the problem of learning partially observed linear dynamical systems from a single sample trajectory. A major practical challenge in the existing system identification methods is the undesirable dep…
Analytical Volume Analysis for the Finite-time Controllable Region of the Linear Discrete-time Systems
In this paper, the works on the analytical volume analysis for the controllable regions of the linear discrete-time (LDT) systems in papers \cite{zhaomw202001} and \cite {zhaomw202004} are discussed further and a new the…
Hypernetwork-based approach for optimal composition design in partially controlled multi-agent systems
Partially Controlled Multi-Agent Systems (PCMAS) are comprised of controllable agents, managed by a system designer, and uncontrollable agents, operating autonomously. This study addresses an optimal composition design p…
Multi-agent Reinforcement LearningSimulation Results of Center-Manifold-Based Identification of Polynomial Nonlinear Systems with Uncontrollable Linearization
Recently, a system identification method based on center manifold is proposed to identify polynomial nonlinear systems with uncontrollable linearization. This note presents a numerical example to show the effectiveness o…