Quality Management of Machine Learning Systems
In the past decade, Artificial Intelligence (AI) has become a part of our daily lives due to major advances in Machine Learning (ML) techniques. In spite of an explosive growth in the raw AI technology and in consumer facing applications on the internet, its adoption in business applications has conspicuously lagged behind. For business/mission-critical systems, serious concerns about reliability and maintainability of AI applications remain. Due to the statistical nature of the output, software 'defects' are not well defined. Consequently, many traditional quality management techniques such as program debugging, static code analysis, functional testing, etc. have to be reevaluated. Beyond the correctness of an AI model, many other new quality attributes, such as fairness, robustness, explainability, transparency, etc. become important in delivering an AI system. The purpose of this paper is to present a view of a holistic quality management framework for ML applications based on the current advances and identify new areas of software engineering research to achieve a more trustworthy AI.
Code (0)
등록된 구현이 없습니다.
Tasks
BIG-bench Machine LearningFairnessManagementSimilar Papers 제목 키워드 기반
Data Quality Awareness: A Journey from Traditional Data Management to Data Science Systems
Artificial intelligence (AI) has transformed various fields, significantly impacting our daily lives. A major factor in AI success is high-quality data. In this paper, we present a comprehensive review of the evolution o…
ManagementEnhancing an Intelligent Digital Twin with a Self-organized Reconfiguration Management based on Adaptive Process Models
Shorter product life cycles and increasing individualization of production leads to an increased reconfiguration demand in the domain of industrial automation systems, which will be dominated by cyber-physical production…
ManagementEnsuring Dataset Quality for Machine Learning Certification
In this paper, we address the problem of dataset quality in the context of Machine Learning (ML)-based critical systems. We briefly analyse the applicability of some existing standards dealing with data and show that the…
BIG-bench Machine LearningManagementImproving Dialogue Management: Quality Datasets vs Models
Task-oriented dialogue systems (TODS) have become crucial for users to interact with machines and computers using natural language. One of its key components is the dialogue manager, which guides the conversation towards…
Dialog LearningDialogue ManagementManagementReinforcement Learning (RL)+1AIOps Solutions for Incident Management: Technical Guidelines and A Comprehensive Literature Review
The management of modern IT systems poses unique challenges, necessitating scalability, reliability, and efficiency in handling extensive data streams. Traditional methods, reliant on manual tasks and rule-based approach…
Management