How do Machine Learning Projects use Continuous Integration Practices? An Empirical Study on GitHub Actions

2024-03-14 · João Helis Bernardo, Daniel Alencar da Costa, Sérgio Queiroz de Medeiros, Uirá Kulesza

Continuous Integration (CI) is a well-established practice in traditional software development, but its nuances in the domain of Machine Learning (ML) projects remain relatively unexplored. Given the distinctive nature of ML development, understanding how CI practices are adopted in this context is crucial for tailoring effective approaches. In this study, we conduct a comprehensive analysis of 185 open-source projects on GitHub (93 ML and 92 non-ML projects). Our investigation comprises both quantitative and qualitative dimensions, aiming to uncover differences in CI adoption between ML and non-ML projects. Our findings indicate that ML projects often require longer build durations, and medium-sized ML projects exhibit lower test coverage compared to non-ML projects. Moreover, small and medium-sized ML projects show a higher prevalence of increasing build duration trends compared to their non-ML counterparts. Additionally, our qualitative analysis illuminates the discussions around CI in both ML and non-ML projects, encompassing themes like CI Build Execution and Status, CI Testing, and CI Infrastructure. These insights shed light on the unique challenges faced by ML projects in adopting CI practices effectively.

📄 PDF Abstract BibTeX arXiv:2403.09547

Code (0)

등록된 구현이 없습니다.

Continuous Integration Practices in Machine Learning Projects: The Practitioners` Perspective

2025-02-24 · João Helis Bernardo, Daniel Alencar da Costa, Filipe Roseiro Cogo, Sérgio Queiróz de Medeiros 외

Continuous Integration (CI) is a cornerstone of modern software development. However, while widely adopted in traditional software projects, applying CI practices to Machine Learning (ML) projects presents distinctive ch…

Detecting Continuous Integration Skip : A Reinforcement Learning-based Approach

2024-05-15 · Hajer Mhalla, Mohamed Aymen Saied

The software industry is experiencing a surge in the adoption of Continuous Integration (CI) practices, both in commercial and open-source environments. CI practices facilitate the seamless integration of code changes by…

Binary Classification Deep Reinforcement Learning reinforcement-learning Reinforcement Learning

A Preliminary Investigation of MLOps Practices in GitHub

2022-09-23 · Fabio Calefato, Filippo Lanubile, Luigi Quaranta

Background. The rapid and growing popularity of machine learning (ML) applications has led to an increasing interest in MLOps, that is, the practice of continuous integration and deployment (CI/CD) of ML-enabled systems.…

DINGO: an ontology for projects and grants linked data

2020-06-24 · Diego Chialva, Alexis-Michel Mugabushaka

We present DINGO (Data INtegration for Grants Ontology), an ontology that provides a machine readable extensible framework to model data for semantically-enabled applications relative to projects, funding, actors, and, n…

Data Integration

ML in a Box: Analyzing Containerization Practices in Open Source ML Projects

2026-07-11 · Faten Jebari, Emna Ksontini, Amine Barrak, Wael Kessentini arxiv

Containerization has become increasingly essential in the machine learning (ML) domain, providing reproducibility, portability, and environment consistency. While prior studies have analyzed Dockerfile structures and bes…