Controller Synthesis for Omega-Regular and Steady-State Specifications
Given a Markov decision process (MDP) and a linear-time ($\omega$-regular or LTL) specification, the controller synthesis problem aims to compute the optimal policy that satisfies the specification. More recently, problems that reason over the asymptotic behavior of systems have been proposed through the lens of steady-state planning. This entails finding a control policy for an MDP such that the Markov chain induced by the solution policy satisfies a given set of constraints on its steady-state distribution. This paper studies a generalization of the controller synthesis problem for a linear-time specification under steady-state constraints on the asymptotic behavior. We present an algorithm to find a deterministic policy satisfying $\omega$-regular and steady-state constraints by characterizing the solutions as an integer linear program, and experimentally evaluate our approach.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Spatiotemporal Tubes based Controller Synthesis against Omega-Regular Specifications for Unknown Systems
This paper provides a discretization-free solution to the synthesis of approx-imation-free closed-form controllers for unknown nonlinear systems to enforce complex properties expressed by $\omega$-regular languages, as r…
Robot NavigationLTL-Constrained Steady-State Policy Synthesis
Decision-making policies for agents are often synthesized with the constraint that a formal specification of behaviour is satisfied. Here we focus on infinite-horizon properties. On the one hand, Linear Temporal Logic (L…
Decision MakingMULTIGAIN 2.0: MDP controller synthesis for multiple mean-payoff, LTL and steady-state constraints
We present MULTIGAIN 2.0, a major extension to the controller synthesis tool MULTIGAIN, built on top of the probabilistic model checker PRISM. This new version extends MULTIGAIN's multi-objective capabilities, by allowin…
Formal Synthesis of Controllers for Uncertain Linear Systems against $ω$-Regular Properties: A Set-based Approach
In this paper, we present how to synthesize controllers to enforce $\omega$-regular properties over linear control systems affected by bounded disturbances. In particular, these controllers are synthesized based on so-ca…
Implementing PID Controller on a hand follower robot using Numerical Methods
Overall, in any system, the proportional term, integral term, and derivative term combined to produce a fast response time, less overshoot, no oscillations, increased stability, and no steady-state errors. Eliminating th…