paper-with-me

홈 › Papers

Assuring the Machine Learning Lifecycle: Desiderata, Methods, and Challenges

2019-05-10 · Rob Ashmore, Radu Calinescu, Colin Paterson

Machine learning has evolved into an enabling technology for a wide range of highly successful applications. The potential for this success to continue and accelerate has placed machine learning (ML) at the top of research, economic and political agendas. Such unprecedented interest is fuelled by a vision of ML applicability extending to healthcare, transportation, defence and other domains of great societal importance. Achieving this vision requires the use of ML in safety-critical applications that demand levels of assurance beyond those needed for current ML applications. Our paper provides a comprehensive survey of the state-of-the-art in the assurance of ML, i.e. in the generation of evidence that ML is sufficiently safe for its intended use. The survey covers the methods capable of providing such evidence at different stages of the machine learning lifecycle, i.e. of the complex, iterative process that starts with the collection of the data used to train an ML component for a system, and ends with the deployment of that component within the system. The paper begins with a systematic presentation of the ML lifecycle and its stages. We then define assurance desiderata for each stage, review existing methods that contribute to achieving these desiderata, and identify open challenges that require further research.

📄 PDF Abstract BibTeX arXiv:1905.04223

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine LearningSurvey

Similar Papers 제목 키워드 기반

Mapping the Potential of Explainable AI for Fairness Along the AI Lifecycle

2024-04-29 · Luca Deck, Astrid Schomäcker, Timo Speith, Jakob Schöffer 외

The widespread use of artificial intelligence (AI) systems across various domains is increasingly surfacing issues related to algorithmic fairness, especially in high-stakes scenarios. Thus, critical considerations of ho…

Explainable artificial intelligenceExplainable Artificial Intelligence (XAI)Fairness

Assuring the Safety of Reinforcement Learning Components: AMLAS-RL

2025-07-08 · Calum Corrie Imrie, Ioannis Stefanakos, Sepeedeh Shahbeigi, Richard Hawkins 외 arxiv

The rapid advancement of machine learning (ML) has led to its increasing integration into cyber-physical systems (CPS) across diverse domains. While CPS offer powerful capabilities, incorporating ML components introduces…

Reinforcement Learning

Foundational Challenges in Assuring Alignment and Safety of Large Language Models

2024-04-15 · Usman Anwar, Abulhair Saparov, Javier Rando, Daniel Paleka 외

This work identifies 18 foundational challenges in assuring the alignment and safety of large language models (LLMs). These challenges are organized into three different categories: scientific understanding of LLMs, deve…

Amazon SageMaker Clarify: Machine Learning Bias Detection and Explainability in the Cloud

2021-09-07 · Michaela Hardt, Xiaoguang Chen, Xiaoyi Cheng, Michele Donini 외

Understanding the predictions made by machine learning (ML) models and their potential biases remains a challenging and labor-intensive task that depends on the application, the dataset, and the specific model. We presen…

Bias DetectionBIG-bench Machine LearningFairnessFeature Importance

Testing and verification of neural-network-based safety-critical control software: A systematic literature review

2019-10-05 · Jin Zhang, Jingyue Li

Context: Neural Network (NN) algorithms have been successfully adopted in a number of Safety-Critical Cyber-Physical Systems (SCCPSs). Testing and Verification (T&V) of NN-based control software in safety-critical domain…

Systematic Literature Review