Is Your Training Pipeline Production-Ready? A Case Study in the Healthcare Domain
Deploying a Machine Learning (ML) training pipeline into production requires robust software engineering practices. This differs significantly from experimental workflows. This experience report investigates this challenge in SPIRA, a project whose goal is to create an ML-Enabled System (MLES) to pre-diagnose insufficiency respiratory via speech analysis. The first version of SPIRA's training pipeline lacked critical software quality attributes. This paper presents an overview of the MLES, then compares three versions of the architecture of the Continuous Training subsystem, which evolved from a Big Ball of Mud, to a Modular Monolith, towards Microservices. By adopting different design principles and patterns to enhance its maintainability, robustness, and extensibility. In this way, the paper seeks to offer insights for both ML Engineers tasked to productionize ML training pipelines and Data Scientists seeking to adopt MLOps practices.
Code (3)
Similar Papers 제목 키워드 기반
SpeechDialogueFactory: Generating High-Quality Speech Dialogue Data to Accelerate Your Speech-LLM Development
High-quality speech dialogue datasets are crucial for Speech-LLM development, yet existing acquisition methods face significant limitations. Human recordings incur high costs and privacy concerns, while synthetic approac…
Speech SynthesisVoice CloningEvaluating the Robustness of a Production Malware Detection System to Transferable Adversarial Attacks
As deep learning models become widely deployed as components within larger production systems, their individual shortcomings can create system-level vulnerabilities with real-world impact. This paper studies how adversar…
Malware DetectionNeuraxle - A Python Framework for Neat Machine Learning Pipelines
Code Machine Learning Pipelines - The Right Way. The present new framework is for building neat pipelines, providing the right abstractions to both ease research, development, and deployment of your ML applications. Most…
AutoMLBIG-bench Machine LearningGenerative Animations: A Multi-Model Pipeline for Prompt-Driven Motion Synthesis
Animation elevates digital documents into immersive experiences, yet creating custom motion paths remains cumbersome, requiring designers to manually select presets, plot Bézier points, and configure timing properties. W…
Motion SynthesisVisual GroundingSemantic ParsingLearning Selective LLM Autonomy from Copilot Feedback in Enterprise Customer Support Workflows
We present a deployed system that automates end-to-end customer support workflows inside an enterprise Business Process Management (BPM) platform. The approach is scalable in production and reaches selective automation w…