paper-with-me

Papers

From Data to Decision: Data-Centric Infrastructure for Reproducible ML in Collaborative eScience

2025-06-19 · Zhiwei Li, Carl Kesselman, Tran Huy Nguyen, Benjamin Yixing Xu, Kyle Bolo, Kimberley Yu

Reproducibility remains a central challenge in machine learning (ML), especially in collaborative eScience projects where teams iterate over data, features, and models. Current ML workflows are often dynamic yet fragmented, relying on informal data sharing, ad hoc scripts, and loosely connected tools. This fragmentation impedes transparency, reproducibility, and the adaptability of experiments over time. This paper introduces a data-centric framework for lifecycle-aware reproducibility, centered around six structured artifacts: Dataset, Feature, Workflow, Execution, Asset, and Controlled Vocabulary. These artifacts formalize the relationships between data, code, and decisions, enabling ML experiments to be versioned, interpretable, and traceable over time. The approach is demonstrated through a clinical ML use case of glaucoma detection, illustrating how the system supports iterative exploration, improves reproducibility, and preserves the provenance of collaborative decisions across the ML lifecycle.

📄 PDF Abstract BibTeX arXiv:2506.16051

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

HOC 설명 없음
Fragmentation Given a pattern $P,$ that is more complicated than the patterns, we fragment $P$ into simpler patterns such that their exact count is known. In the subgraph GNN proposed earlier,…

Similar Papers 제목 키워드 기반

A Modular Benchmarking Infrastructure for High-Performance and Reproducible Deep Learning

2019-01-29 · Tal Ben-Nun, Maciej Besta, Simon Huber, Alexandros Nikolaos Ziogas 외

We introduce Deep500: the first customizable benchmarking infrastructure that enables fair comparison of the plethora of deep learning frameworks, algorithms, libraries, and techniques. The key idea behind Deep500 is its…

BenchmarkingDeep LearningVocal Bursts Intensity Prediction

Rethinking the Role of Infrastructure in Collaborative Perception

2024-10-15 · Hyunchul Bae, Minhee Kang, Minwoo Song, Heejin Ahn

Collaborative Perception (CP) is a process in which an ego agent receives and fuses sensor information from surrounding vehicles and infrastructure to enhance its perception capability. To evaluate the need for infrastru…

FinRL-X: An AI-Native Modular Infrastructure for Quantitative Trading

2026-03-22 · Hongyang Yang, Boyu Zhang, Yang She, Xinyu Liao 외 arxiv

We present FinRL-X, a modular and deployment-consistent trading architecture that unifies data processing, strategy construction, backtesting, and broker execution under a weight-centric interface. While existing open-so…

Reinforcement Learning

Towards Comprehensive Benchmarking Infrastructure for LLMs In Software Engineering

2026-01-28 · Daniel Rodriguez-Cardenas, Xiaochang Li, Marcos Macedo, Antonio Mastropaolo 외 arxiv

Large language models for code are advancing fast, yet our ability to evaluate them lags behind. Current benchmarks focus on narrow tasks and single metrics, which hide critical gaps in robustness, interpretability, fair…

DataFlex: A Unified Framework for Data-Centric Dynamic Training of Large Language Models

2026-03-27 · Hao Liang, Zhengyang Zhao, Meiyi Qiang, Mingrui Chen 외 arxiv

Data-centric training has emerged as a promising direction for improving large language models (LLMs) by optimizing not only model parameters but also the selection, composition, and weighting of training data during opt…