paper-with-me

Papers

Scalable and Interpretable Verification of Image-based Neural Network Controllers for Autonomous Vehicles

2025-01-23 · Aditya Parameshwaran, Yue Wang

Existing formal verification methods for image-based neural network controllers in autonomous vehicles often struggle with high-dimensional inputs, computational inefficiency, and a lack of explainability. These challenges make it difficult to ensure safety and reliability, as processing high-dimensional image data is computationally intensive and neural networks are typically treated as black boxes. To address these issues, we propose SEVIN (Scalable and Explainable Verification of Image-Based Neural Network Controllers), a framework that leverages a Variational Autoencoders (VAE) to encode high-dimensional images into a lower-dimensional, explainable latent space. By annotating latent variables with corresponding control actions, we generate convex polytopes that serve as structured input spaces for verification, significantly reducing computational complexity and enhancing scalability. Integrating the VAE's decoder with the neural network controller allows for formal and robustness verification using these explainable polytopes. Our approach also incorporates robustness verification under real-world perturbations by augmenting the dataset and retraining the VAE to capture environmental variations. Experimental results demonstrate that SEVIN achieves efficient and scalable verification while providing explainable insights into controller behavior, bridging the gap between formal verification techniques and practical applications in safety-critical systems.

📄 PDF Abstract BibTeX arXiv:2501.14009

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous VehiclesDecoder

Similar Papers 제목 키워드 기반

Learning Vision-Based Neural Network Controllers with Semi-Probabilistic Safety Guarantees

2025-02-28 · Xinhang Ma, Junlin Wu, Hussein Sibai, Yiannis Kantaros 외

Ensuring safety in autonomous systems with vision-based control remains a critical challenge due to the high dimensionality of image inputs and the fact that the relationship between true system state and its visual mani…

Bridging Dimensions: Confident Reachability for High-Dimensional Controllers

2023-11-08 · Yuang Geng, Jake Brandon Baldauf, Souradeep Dutta, Chao Huang 외

Autonomous systems are increasingly implemented using end-to-end learning-based controllers. Such controllers make decisions that are executed on the real system, with images as one of the primary sensing modalities. Dee…

Knowledge DistillationOpenAI Gym

Safety Verification of Model Based Reinforcement Learning Controllers

2020-10-21 · Akshita Gupta, Inseok Hwang

Model-based reinforcement learning (RL) has emerged as a promising tool for developing controllers for real world systems (e.g., robotics, autonomous driving, etc.). However, real systems often have constraints imposed o…

Autonomous DrivingmodelModel-based Reinforcement Learningreinforcement-learning+2

Verification of Visual Controllers via Compositional Geometric Transformations

2025-07-06 · Alexander Estornell, Leonard Jung, Michael Everett arxiv

Perception-based neural network controllers are increasingly used in autonomous systems that rely on visual inputs to operate in the real world. Ensuring the safety of such systems under uncertainty is challenging. Exist…

Neural Network Based Model Predictive Control for an Autonomous Vehicle

2021-07-30 · Maria Luiza Costa Vianna, Eric Goubault, Sylvie Putot

We study learning based controllers as a replacement for model predictive controllers (MPC) for the control of autonomous vehicles. We concentrate for the experiments on the simple yet representative bicycle model. We co…

Autonomous VehiclesModel Predictive Controlreinforcement-learningReinforcement Learning (RL)