Improving Radiography Machine Learning Workflows via Metadata Management for Training Data Selection
Most machine learning models require many iterations of hyper-parameter tuning, feature engineering, and debugging to produce effective results. As machine learning models become more complicated, this pipeline becomes more difficult to manage effectively. In the physical sciences, there is an ever-increasing pool of metadata that is generated by the scientific research cycle. Tracking this metadata can reduce redundant work, improve reproducibility, and aid in the feature and training dataset engineering process. In this case study, we present a tool for machine learning metadata management in dynamic radiography. We evaluate the efficacy of this tool against the initial research workflow and discuss extensions to general machine learning pipelines in the physical sciences.
Code (0)
등록된 구현이 없습니다.
Tasks
Feature EngineeringManagementSimilar Papers 제목 키워드 기반
ML-Asset Management: Curation, Discovery, and Utilization
Machine learning (ML) assets, such as models, datasets, and metadata, are central to modern ML workflows. Despite their explosive growth in practice, these assets are often underutilized due to fragmented documentation, …
Spatialyze: A Geospatial Video Analytics System with Spatial-Aware Optimizations
Videos that are shot using commodity hardware such as phones and surveillance cameras record various metadata such as time and location. We encounter such geospatial videos on a daily basis and such videos have been grow…
ManagementIonSense-QKG: A Quantum-Readiness Metadata Framework for Lithium-Ion Battery Dataset Discovery
Public lithium-ion battery datasets are increasingly used for state-of-health estimation, remaining-useful-life prediction, anomaly detection, electrochemical diagnostics, second-life analytics, and battery safety resear…
Anomaly DetectionPHMD: An easy data access tool for prognosis and health management datasets
This work introduces a comprehensive open-source Python library designed for seamless access and handling of Prognostics and Health Management (PHM) datasets. The library currently supports 59 datasets from diverse domai…
Anomaly DetectionFault DetectionFault DiagnosisManagement+3Metadata practices for simulation workflows
Computer simulations are an essential pillar of knowledge generation in science. Understanding, reproducing, and exploring the results of simulations relies on tracking and organizing metadata describing numerical experi…