paper-with-me

Papers

Concrete Safety for ML Problems: System Safety for ML Development and Assessment

2023-02-06 · Edgar W. Jatho, Logan O. Mailloux, Eugene D. Williams, Patrick McClure, Joshua A. Kroll

Many stakeholders struggle to make reliances on ML-driven systems due to the risk of harm these systems may cause. Concerns of trustworthiness, unintended social harms, and unacceptable social and ethical violations undermine the promise of ML advancements. Moreover, such risks in complex ML-driven systems present a special challenge as they are often difficult to foresee, arising over periods of time, across populations, and at scale. These risks often arise not from poor ML development decisions or low performance directly but rather emerge through the interactions amongst ML development choices, the context of model use, environmental factors, and the effects of a model on its target. Systems safety engineering is an established discipline with a proven track record of identifying and managing risks even in high-complexity sociotechnical systems. In this work, we apply a state-of-the-art systems safety approach to concrete applications of ML with notable social and ethical risks to demonstrate a systematic means for meeting the assurance requirements needed to argue for safe and trustworthy ML in sociotechnical systems.

📄 PDF Abstract BibTeX arXiv:2302.02972

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Unsolved Problems in ML Safety

2021-09-28 · Dan Hendrycks, Nicholas Carlini, John Schulman, Jacob Steinhardt

Machine learning (ML) systems are rapidly increasing in size, are acquiring new capabilities, and are increasingly deployed in high-stakes settings. As with other powerful technologies, safety for ML should be a leading …

Position: Preventing AI-Generated CSAM Necessitates New Approaches to AI Safety

2026-06-09 · Neil Kale, Rebecca Portnoff, Pratiksha Thaker, Michael Simpson 외 arxiv

Modern artificial intelligence (AI) systems present profound new risks to child safety. AI is increasingly being misused to create AI-generated child sexual abuse material, facilitate child sexual exploitation, and reduc…

Red Teaming

Concrete Problems in AI Safety, Revisited

2023-12-18 · Inioluwa Deborah Raji, Roel Dobbe

As AI systems proliferate in society, the AI community is increasingly preoccupied with the concept of AI Safety, namely the prevention of failures due to accidents that arise from an unanticipated departure of a system'…

The Role of Explainability in Assuring Safety of Machine Learning in Healthcare

2021-09-01 · Yan Jia, John McDermid, Tom Lawton, Ibrahim Habli

Established approaches to assuring safety-critical systems and software are difficult to apply to systems employing ML where there is no clear, pre-defined specification against which to assess validity. This problem is …

BIG-bench Machine LearningExplainable Artificial Intelligence (XAI)

Contribution to the Formal Specification and Verification of a Multi-Agent Robotic System

2015-10-02 · Nadeem Akhtar, Malik M. Saad Missen

It is important to have multi-agent robotic system specifications that ensure correctness properties of safety and liveness. As these systems have concurrency, and often have dynamic environment, the formal specification…