Incorporating System-level Safety Requirements in Perception Models via Reinforcement Learning
Perception components in autonomous systems are often developed and optimized independently of downstream decision-making and control components, relying on established performance metrics like accuracy, precision, and recall. Traditional loss functions, such as cross-entropy loss and negative log-likelihood, focus on reducing misclassification errors but fail to consider their impact on system-level safety, overlooking the varying severities of system-level failures caused by these errors. To address this limitation, we propose a novel training paradigm that augments the perception component with an understanding of system-level safety objectives. Central to our approach is the translation of system-level safety requirements, formally specified using the rulebook formalism, into safety scores. These scores are then incorporated into the reward function of a reinforcement learning framework for fine-tuning perception models with system-level safety objectives. Simulation results demonstrate that models trained with this approach outperform baseline perception models in terms of system-level safety.
Code (0)
등록된 구현이 없습니다.
Tasks
Decision MakingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Decomposition and Quantification of SOTIF Requirements for Perception Systems of Autonomous Vehicles
Ensuring the safety of autonomous vehicles (AVs) is paramount before they can be introduced to the market. More specifically, securing the Safety of the Intended Functionality (SOTIF) poses a notable challenge; while ISO…
Autonomous VehiclesThe missing link: Developing a safety case for perception components in automated driving
Safety assurance is a central concern for the development and societal acceptance of automated driving (AD) systems. Perception is a key aspect of AD that relies heavily on Machine Learning (ML). Despite the known challe…
Efficient Determination of Safety Requirements for Perception Systems
Perception systems operate as a subcomponent of the general autonomy stack, and perception system designers often need to optimize performance characteristics while maintaining safety with respect to the overall closed-l…
Collision AvoidanceGaussian ProcessesRobustness Requirement Coverage using a Situation Coverage Approach for Vision-based AI Systems
AI-based robots and vehicles are expected to operate safely in complex and dynamic environments, even in the presence of component degradation. In such systems, perception relies on sensors such as cameras to capture env…
Refining Perception Contracts: Case Studies in Vision-based Safe Auto-landing
Perception contracts provide a method for evaluating safety of control systems that use machine learning for perception. A perception contract is a specification for testing the ML components, and it gives a method for p…