paper-with-me

Papers

A Guide to Computational Reproducibility in Signal Processing and Machine Learning

2021-08-27 · Joseph Shenouda, Waheed U. Bajwa

Computational reproducibility is a growing problem that has been extensively studied among computational researchers and within the signal processing and machine learning research community. However, with the changing landscape of signal processing and machine learning research come new obstacles and unseen challenges in creating reproducible experiments. Due to these new challenges most computational experiments have become difficult, if not impossible, to be reproduced by an independent researcher. In 2016 a survey conducted by the journal Nature found that 50% of researchers were unable to reproduce their own experiments. While the issue of computational reproducibility has been discussed in the literature and specifically within the signal processing community, it is still unclear to most researchers what are the best practices to ensure reproducibility without impinging on their primary responsibility of conducting research. We feel that although researchers understand the importance of making experiments reproducible, the lack of a clear set of standards and tools makes it difficult to incorporate good reproducibility practices in most labs. It is in this regard that we aim to present signal processing researchers with a set of practical tools and strategies that can help mitigate many of the obstacles to producing reproducible computational experiments.

📄 PDF Abstract BibTeX arXiv:2108.12383

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine Learning

Similar Papers 제목 키워드 기반

Large Language Models for Software Engineering: A Reproducibility Crisis

2025-11-29 · Mohammed Latif Siddiq, Arvin Islam-Gomes, Natalie Sekerak, Joanna C. S. Santos arxiv

Reproducibility is a cornerstone of scientific progress, yet its state in large language model (LLM)-based software engineering (SE) research remains poorly understood. This paper presents the first large-scale, empirica…

Towards Reproducible Machine Learning Research in Natural Language Processing

2022-05-01 · ACL 2022 5 · Ana Lucic, Maurits Bleeker, Samarth Bhargav, Jessica Forde 외

While recent progress in the field of ML has been significant, the reproducibility of these cutting-edge results is often lacking, with many submissions lacking the necessary information in order to ensure subsequent rep…

BIG-bench Machine Learning

CC30k: A Citation Contexts Dataset for Reproducibility-Oriented Sentiment Analysis

2025-11-11 · Rochana R. Obadage, Sarah M. Rajtmajer, Jian Wu arxiv

Sentiments about the reproducibility of cited papers in downstream literature offer community perspectives and have shown as a promising signal of the actual reproducibility of published findings. To train effective mode…

Sentiment Analysis

Reproducibility in machine learning for medical imaging

2022-09-12 · Olivier Colliot, Elina Thibeau-Sutre, Ninon Burgos

Reproducibility is a cornerstone of science, as the replication of findings is the process through which they become knowledge. It is widely considered that many fields of science are undergoing a reproducibility crisis.…

Reproducibility of Machine Learning-Based Fault Detection and Diagnosis for HVAC Systems in Buildings: An Empirical Study

2025-07-23 · Adil Mukhtar, Michael Hadwiger, Franz Wotawa, Gerald Schweiger arxiv

Reproducibility is a cornerstone of scientific research, enabling independent verification and validation of empirical findings. The topic gained prominence in fields such as psychology and medicine, where concerns about…