paper-with-me

Papers

Position: More Rigorous Software Engineering Would Improve Reproducibility in Machine Learning Research

2025-02-02 · Moritz Wolter, Lokesh Veeramacheneni

Experimental verification and falsification of scholarly work are part of the scientific method's core. To improve the Machine Learning (ML)-communities' ability to verify results from prior work, we argue for more robust software engineering. We estimate the adoption of common engineering best practices by examining repository links from all recently accepted International Conference on Machine Learning (ICML), International Conference on Learning Representations (ICLR) and Neural Information Processing Systems (NeurIPS) papers as well as ICML papers over time. Based on the results, we recommend how we, as a community, can improve reproducibility in ML-research.

📄 PDF Abstract BibTeX arXiv:2502.00902

Code (1)

BonnBytes/position_we_need_more_tests_in_ml 공식 구현 jax

Tasks

Position

Similar Papers 제목 키워드 기반

Imandra CodeLogician: Neuro-Symbolic Reasoning for Precise Analysis of Software Logic

2026-01-17 · Hongyu Lin, Samer Abdallah, Makar Valentinov, Paul Brennan 외 arxiv

Large Language Models (LLMs) have shown strong performance on code understanding tasks, yet they fundamentally lack the ability to perform precise, exhaustive mathematical reasoning about program behavior. Existing bench…

Mathematical Reasoning

More Is Different: Toward a Theory of Emergence in AI-Native Software Ecosystems

2026-04-20 · Daniel Russo arxiv

Software engineering faces a fundamental challenge: multi-agent AI systems fail in ways that defy explanation by traditional theories. While individual agents perform correctly, their interactions degrade entire ecosyste…

Machine Learning for Software Engineering: A Systematic Mapping

2020-05-27 · Saad Shafiq, Atif Mashkoor, Christoph Mayr-Dorn, Alexander Egyed

Context: The software development industry is rapidly adopting machine learning for transitioning modern day software systems towards highly intelligent and self-learning systems. However, the full potential of machine l…

ArticlesBIG-bench Machine LearningSelf-Learning

Seamless Digital Engineering: A Grand Challenge Driven by Needs

2024-01-04 · James S. Wheaton, Daniel R. Herber

Digital Engineering currently relies on costly and often bespoke integration of disparate software products to assemble the authoritative source of truth of the system-of-interest. Tools not originally designed to work t…

Agentic AI for Software: thoughts from Software Engineering community

2025-08-24 · Abhik Roychoudhury arxiv

AI agents have recently shown significant promise in software engineering. Much public attention has been transfixed on the topic of code generation from Large Language Models (LLMs) via a prompt. However, software engin…

Code GenerationProgram Repair