paper-with-me

Papers

What are the Machine Learning best practices reported by practitioners on Stack Exchange?

2023-01-25 · Anamaria Mojica-Hanke, Andrea Bayona, Mario Linares-Vásquez, Steffen Herbold, Fabio A. González

Machine Learning (ML) is being used in multiple disciplines due to its powerful capability to infer relationships within data. In particular, Software Engineering (SE) is one of those disciplines in which ML has been used for multiple tasks, like software categorization, bugs prediction, and testing. In addition to the multiple ML applications, some studies have been conducted to detect and understand possible pitfalls and issues when using ML. However, to the best of our knowledge, only a few studies have focused on presenting ML best practices or guidelines for the application of ML in different domains. In addition, the practices and literature presented in previous literature (i) are domain-specific (e.g., concrete practices in biomechanics), (ii) describe few practices, or (iii) the practices lack rigorous validation and are presented in gray literature. In this paper, we present a study listing 127 ML best practices systematically mining 242 posts of 14 different Stack Exchange (STE) websites and validated by four independent ML experts. The list of practices is presented in a set of categories related to different stages of the implementation process of an ML-enabled system; for each practice, we include explanations and examples. In all the practices, the provided examples focus on SE tasks. We expect this list of practices could help practitioners to understand better the practices and use ML in a more informed way, in particular newcomers to this new area that sits at the intersection of software engineering and machine learning.

📄 PDF Abstract BibTeX arXiv:2301.10516

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Machine Learning Application Development: Practitioners' Insights

2021-12-31 · Md Saidur Rahman, Foutse khomh, Alaleh Hamidi, Jinghui Cheng 외

Nowadays, intelligent systems and services are getting increasingly popular as they provide data-driven solutions to diverse real-world problems, thanks to recent breakthroughs in Artificial Intelligence (AI) and Machine…

BIG-bench Machine Learning

Test & Evaluation Best Practices for Machine Learning-Enabled Systems

2023-10-10 · Jaganmohan Chandrasekaran, Tyler Cody, Nicola McCarthy, Erin Lanus 외

Machine learning (ML) - based software systems are rapidly gaining adoption across various domains, making it increasingly essential to ensure they perform as intended. This report presents best practices for the Test an…

What Makes an Evaluation Useful? Common Pitfalls and Best Practices

2025-03-30 · Gil Gekker, Meirav Segal, Dan Lahav, Omer Nevo

Following the rapid increase in Artificial Intelligence (AI) capabilities in recent years, the AI community has voiced concerns regarding possible safety risks. To support decision-making on the safe use and development …

Decision Making

Establishing Best Practices for Building Rigorous Agentic Benchmarks

2025-07-03 · Yuxuan Zhu, Tengjun Jin, Yada Pruksachatkun, Andy Zhang 외 arxiv

Benchmarks are essential for quantitatively tracking progress in AI. As AI agents become increasingly capable, researchers and practitioners have introduced agentic benchmarks to evaluate agents on complex, real-world ta…

Towards machine learning guided by best practices

2023-04-29 · Anamaria Mojica-Hanke

Nowadays, machine learning (ML) is being used in software systems with multiple application fields, from medicine to software engineering (SE). On the one hand, the popularity of ML in the industry can be seen in the sta…