paper-with-me

Papers

Assessing Confidence with Assurance 2.0

2022-05-03 · Robin Bloomfield, John Rushby

An assurance case is intended to provide justifiable confidence in the truth of its top claim, which typically concerns safety or security. A natural question is then "how much" confidence does the case provide? We argue that confidence cannot be reduced to a single attribute or measurement. Instead, we suggest it should be based on attributes that draw on three different perspectives: positive, negative, and residual doubts. Positive Perspectives consider the extent to which the evidence and overall argument of the case combine to make a positive statement justifying belief in its claims. We set a high bar for justification, requiring it to be indefeasible. The primary positive measure for this is soundness, which interprets the argument as a logical proof. Confidence in evidence can be expressed probabilistically and we use confirmation measures to ensure that the "weight" of evidence crosses some threshold. In addition, probabilities can be aggregated from evidence through the steps of the argument using probability logics to yield what we call probabilistic valuations for the claims. Negative Perspectives record doubts and challenges to the case, typically expressed as defeaters, and their exploration and resolution. Assurance developers must guard against confirmation bias and should vigorously explore potential defeaters as they develop the case, and should record them and their resolution to avoid rework and to aid reviewers. Residual Doubts: the world is uncertain so not all potential defeaters can be resolved. We explore risks and may deem them acceptable or unavoidable. It is crucial however that these judgments are conscious ones and that they are recorded in the assurance case. This report examines the perspectives in detail and indicates how Clarissa, our prototype toolset for Assurance 2.0, assists in their evaluation.

📄 PDF Abstract BibTeX arXiv:2205.04522

Code (0)

등록된 구현이 없습니다.

Tasks

Attribute

Similar Papers 제목 키워드 기반

Factorized Machine Self-Confidence for Decision-Making Agents

2018-10-15 · Brett W. Israelsen, Nisar R. Ahmed, Eric Frew, Dale Lawrence 외

Algorithmic assurances from advanced autonomous systems assist human users in understanding, trusting, and using such systems appropriately. Designing these systems with the capacity of assessing their own capabilities i…

Decision MakingDecision Making Under UncertaintyReinforcement Learning

Towards a compositional semantics for quantitative confidence assessment in assurance arguments

2026-05-21 · Benjamin Herd, Jessica Kelly, Jan Sabsch, Lydia Gauerhof arxiv

Assurance arguments provide a clear and structured way to explain why stakeholders should trust that a system satisfies certain properties, yet widely used notations, e.g.Goal Structuring Notation (GSN), typically lack a…

A Principles-based Ethics Assurance Argument Pattern for AI and Autonomous Systems

2022-03-29 · Zoe Porter, Ibrahim Habli, John McDermid, Marten Kaas

An assurance case is a structured argument, typically produced by safety engineers, to communicate confidence that a critical or complex system, such as an aircraft, will be acceptably safe within its intended context. A…

Ethics

Quantifying Assurance in Learning-enabled Systems

2020-06-18 · Erfan Asaadi, Ewen Denney, Ganesh Pai

Dependability assurance of systems embedding machine learning(ML) components---so called learning-enabled systems (LESs)---is a key step for their use in safety-critical applications. In emerging standardization and guid…

A Subjective Logic-based method for runtime confidence updates in safety arguments

2026-05-21 · Benjamin Herd, Jessica Kelly, Clarissa Heinemann, João-Vitor Zacchi arxiv

We present a method for dynamic quantitative assurance that enhances static safety cases with continuous, runtime-driven confidence updates. The method quantifies and propagates confidence across the development lifecycl…