Robust Guarantees for Perception-Based Control
Motivated by vision-based control of autonomous vehicles, we consider the problem of controlling a known linear dynamical system for which partial state information, such as vehicle position, is extracted from complex and nonlinear data, such as a camera image. Our approach is to use a learned perception map that predicts some linear function of the state and to design a corresponding safe set and robust controller for the closed loop system with this sensing scheme. We show that under suitable smoothness assumptions on both the perception map and the generative model relating state to complex and nonlinear data, parameters of the safe set can be learned via appropriately dense sampling of the state space. We then prove that the resulting perception-control loop has favorable generalization properties. We illustrate the usefulness of our approach on a synthetic example and on the self-driving car simulation platform CARLA.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous VehiclesPositionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
State-Dependent Conformal Perception Bounds for Neuro-Symbolic Verification of Autonomous Systems
It remains a challenge to provide safety guarantees for autonomous systems with neural perception and control. A typical approach obtains symbolic bounds on perception error (e.g., using conformal prediction) and perform…
Conformal PredictionGuaranteeing Safety of Learned Perception Modules via Measurement-Robust Control Barrier Functions
Modern nonlinear control theory seeks to develop feedback controllers that endow systems with properties such as safety and stability. The guarantees ensured by these controllers often rely on accurate estimates of the s…
Safe Perception-Based Control under Stochastic Sensor Uncertainty using Conformal Prediction
We consider perception-based control using state estimates that are obtained from high-dimensional sensor measurements via learning-enabled perception maps. However, these perception maps are not perfect and result in st…
Conformal PredictionState EstimationvalidActive Perception and Control from PrSTL Specifications
Next-generation intelligent systems must plan and execute complex tasks with imperfect information about their environment. As a result, plans must also include actions to learn about the environment. This is known as ac…
Proof-of-Perception: Certified Tool-Using Multimodal Reasoning with Compositional Conformal Guarantees
We present Proof-of-Perception (PoP), a tool-using framework that casts multimodal reasoning as an executable graph with explicit reliability guarantees. Each perception or logic node outputs a conformal set, yielding ca…
Multimodal Reasoning