Management of Machine Learning Lifecycle Artifacts: A Survey
The explorative and iterative nature of developing and operating machine learning (ML) applications leads to a variety of artifacts, such as datasets, features, models, hyperparameters, metrics, software, configurations, and logs. In order to enable comparability, reproducibility, and traceability of these artifacts across the ML lifecycle steps and iterations, systems and tools have been developed to support their collection, storage, and management. It is often not obvious what precise functional scope such systems offer so that the comparison and the estimation of synergy effects between candidates are quite challenging. In this paper, we aim to give an overview of systems and platforms which support the management of ML lifecycle artifacts. Based on a systematic literature review, we derive assessment criteria and apply them to a representative selection of more than 60 systems and platforms.
Code (0)
등록된 구현이 없습니다.
Tasks
ManagementSurveySystematic Literature ReviewSimilar Papers 제목 키워드 기반
Aspect-Based Sentiment Analysis for Open-Ended HR Survey Responses
Understanding preferences, opinions, and sentiment of the workforce is paramount for effective employee lifecycle management. Open-ended survey responses serve as a valuable source of information. This paper proposes a m…
Aspect-Based Sentiment AnalysisAspect-Based Sentiment Analysis (ABSA)ManagementSentiment Analysis+1Gypscie: A Cross-Platform AI Artifact Management System
Artificial Intelligence (AI) models, encompassing both traditional machine learning (ML) and more advanced approaches such as deep learning and large language models (LLMs), play a central role in modern applications. AI…
ModelHub: Towards Unified Data and Lifecycle Management for Deep Learning
Deep learning has improved state-of-the-art results in many important fields, and has been the subject of much research in recent years, leading to the development of several systems for facilitating deep learning. Curre…
Deep LearningManagementML-Asset Management: Curation, Discovery, and Utilization
Machine learning (ML) assets, such as models, datasets, and metadata, are central to modern ML workflows. Despite their explosive growth in practice, these assets are often underutilized due to fragmented documentation, …
Orchestrating the Development Lifecycle of Machine Learning-Based IoT Applications: A Taxonomy and Survey
Machine Learning (ML) and Internet of Things (IoT) are complementary advances: ML techniques unlock complete potentials of IoT with intelligence, and IoT applications increasingly feed data collected by sensors into ML m…
BIG-bench Machine Learning