paper-with-me

Papers

What is Reproducibility in Artificial Intelligence and Machine Learning Research?

2024-04-29 · Abhyuday Desai, Mohamed Abdelhamid, Nakul R. Padalkar

In the rapidly evolving fields of Artificial Intelligence (AI) and Machine Learning (ML), the reproducibility crisis underscores the urgent need for clear validation methodologies to maintain scientific integrity and encourage advancement. The crisis is compounded by the prevalent confusion over validation terminology. In response to this challenge, we introduce a framework that clarifies the roles and definitions of key validation efforts: repeatability, dependent and independent reproducibility, and direct and conceptual replicability. This structured framework aims to provide AI/ML researchers with the necessary clarity on these essential concepts, facilitating the appropriate design, conduct, and interpretation of validation studies. By articulating the nuances and specific roles of each type of validation study, we aim to enhance the reliability and trustworthiness of research findings and support the community's efforts to address reproducibility challenges effectively.

📄 PDF Abstract BibTeX arXiv:2407.10239

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

What Do Machine Learning Researchers Mean by "Reproducible"?

2024-12-05 · Edward Raff, Michel Benaroch, Sagar Samtani, Andrew L. Farris

The concern that Artificial Intelligence (AI) and Machine Learning (ML) are entering a "reproducibility crisis" has spurred significant research in the past few years. Yet with each paper, it is often unclear what someon…

AIR5: Five Pillars of Artificial Intelligence Research

2018-12-30 · Yew-Soon Ong, Abhishek Gupta

In this article, we provide and overview of what we consider to be some of the most pressing research questions facing the fields of artificial intelligence (AI) and computational intelligence (CI); with the latter focus…

Artificial Life

Reproducibility in Machine Learning-Driven Research

2023-07-19 · Harald Semmelrock, Simone Kopeinik, Dieter Theiler, Tony Ross-Hellauer 외

Research is facing a reproducibility crisis, in which the results and findings of many studies are difficult or even impossible to reproduce. This is also the case in machine learning (ML) and artificial intelligence (AI…

Reproducibility of Machine Learning: Terminology, Recommendations and Open Issues

2023-02-24 · Riccardo Albertoni, Sara Colantonio, Piotr Skrzypczyński, Jerzy Stefanowski

Reproducibility is one of the core dimensions that concur to deliver Trustworthy Artificial Intelligence. Broadly speaking, reproducibility can be defined as the possibility to reproduce the same or a similar experiment …

Detection of Fake Generated Scientific Abstracts

2023-04-12 · Panagiotis C. Theocharopoulos, Panagiotis Anagnostou, Anastasia Tsoukala, Spiros V. Georgakopoulos 외

The widespread adoption of Large Language Models and publicly available ChatGPT has marked a significant turning point in the integration of Artificial Intelligence into people's everyday lives. The academic community ha…

Text Classification