Ensuring Dataset Quality for Machine Learning Certification
In this paper, we address the problem of dataset quality in the context of Machine Learning (ML)-based critical systems. We briefly analyse the applicability of some existing standards dealing with data and show that the specificities of the ML context are neither properly captured nor taken into ac-count. As a first answer to this concerning situation, we propose a dataset specification and verification process, and apply it on a signal recognition system from the railway domain. In addi-tion, we also give a list of recommendations for the collection and management of datasets. This work is one step towards the dataset engineering process that will be required for ML to be used on safety critical systems.
Code (0)
등록된 구현이 없습니다.
Tasks
BIG-bench Machine LearningManagementSimilar Papers 제목 키워드 기반
SIEVE: Towards Verifiable Certification for Code-datasets
Code agents and empirical software engineering rely on public code datasets, yet these datasets lack verifiable quality guarantees. Static 'dataset cards' inform, but they are neither auditable nor do they offer statisti…
Scalable Certified Segmentation via Randomized Smoothing
We present a new certification method for image and point cloud segmentation based on randomized smoothing. The method leverages a novel scalable algorithm for prediction and certification that correctly accounts for mul…
Point Cloud SegmentationSegmentationRefCo and its Checker: Improving Language Documentation Corpora’s Reusability Through a Semi-Automatic Review Process
The QUEST (QUality ESTablished) project aims at ensuring the reusability of audio-visual datasets (Wamprechtshammer et al., 2022) by devising quality criteria and curating processes. RefCo (Reference Corpora) is an initi…
Trusted Artificial Intelligence: Towards Certification of Machine Learning Applications
Artificial Intelligence is one of the fastest growing technologies of the 21st century and accompanies us in our daily lives when interacting with technical applications. However, reliance on such technical systems is cr…
BIG-bench Machine LearningEthicsFederated Learning with Blockchain-Enhanced Machine Unlearning: A Trustworthy Approach
With the growing need to comply with privacy regulations and respond to user data deletion requests, integrating machine unlearning into IoT-based federated learning has become imperative. Traditional unlearning methods,…
Federated LearningMachine UnlearningManagement