Datamorphic Testing: A Methodology for Testing AI Applications
With the rapid growth of the applications of machine learning (ML) and other artificial intelligence (AI) techniques, adequate testing has become a necessity to ensure their quality. This paper identifies the characteristics of AI applications that distinguish them from traditional software, and analyses the main difficulties in applying existing testing methods. Based on this analysis, we propose a new method called datamorphic testing and illustrate the method with an example of testing face recognition applications. We also report an experiment with four real industrial application systems of face recognition to validate the proposed approach.
Code (0)
등록된 구현이 없습니다.
Tasks
BIG-bench Machine LearningFace RecognitionSimilar Papers 제목 키워드 기반
Discovering Boundary Values of Feature-based Machine Learning Classifiers through Exploratory Datamorphic Testing
Testing has been widely recognised as difficult for AI applications. This paper proposes a set of testing strategies for testing machine learning applications in the framework of the datamorphism testing methodology. In …
BIG-bench Machine LearningMorphy: A Datamorphic Software Test Automation Tool
This paper presents an automated tool called Morphy for datamorphic testing. It classifies software test artefacts into test entities and test morphisms, which are mappings on testing entities. In addition to datamorphis…
Error Parity Fairness: Testing for Group Fairness in Regression Tasks
The applications of Artificial Intelligence (AI) surround decisions on increasingly many aspects of human lives. Society responds by imposing legal and social expectations for the accountability of such automated decisio…
FairnessregressionAn Efficient Model Inference Algorithm for Learning-based Testing of Reactive Systems
Learning-based testing (LBT) is an emerging methodology to automate iterative black-box requirements testing of software systems. The methodology involves combining model inference with model checking techniques. However…
Incremental LearningEnabling Radio Sensing for Multimodal Intelligent Transportation Systems: From Virtual Testing to Immersive Testbeds
In this paper, the necessity for application-oriented development and evaluation of Joint Communication and Sensing (JC&S) applications, especially in transportation, is addressed. More specifically, an integrative evalu…