paper-with-me

Papers

Technology Readiness Levels for Machine Learning Systems

2021-01-11 · Alexander Lavin, Ciarán M. Gilligan-Lee, Alessya Visnjic, Siddha Ganju, Dava Newman, Atılım Güneş Baydin, Sujoy Ganguly, Danny Lange, Amit Sharma, Stephan Zheng, Eric P. Xing, Adam Gibson, James Parr, Chris Mattmann, Yarin Gal

The development and deployment of machine learning (ML) systems can be executed easily with modern tools, but the process is typically rushed and means-to-an-end. The lack of diligence can lead to technical debt, scope creep and misaligned objectives, model misuse and failures, and expensive consequences. Engineering systems, on the other hand, follow well-defined processes and testing standards to streamline development for high-quality, reliable results. The extreme is spacecraft systems, where mission critical measures and robustness are ingrained in the development process. Drawing on experience in both spacecraft engineering and ML (from research through product across domain areas), we have developed a proven systems engineering approach for machine learning development and deployment. Our "Machine Learning Technology Readiness Levels" (MLTRL) framework defines a principled process to ensure robust, reliable, and responsible systems while being streamlined for ML workflows, including key distinctions from traditional software engineering. Even more, MLTRL defines a lingua franca for people across teams and organizations to work collaboratively on artificial intelligence and machine learning technologies. Here we describe the framework and elucidate it with several real world use-cases of developing ML methods from basic research through productization and deployment, in areas such as medical diagnostics, consumer computer vision, satellite imagery, and particle physics.

📄 PDF Abstract BibTeX arXiv:2101.03989

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine Learning

Similar Papers 제목 키워드 기반

Technology Readiness Levels for AI & ML

2020-06-21 · Alexander Lavin, Gregory Renard

The development and deployment of machine learning systems can be executed easily with modern tools, but the process is typically rushed and means-to-an-end. The lack of diligence can lead to technical debt, scope creep …

BIG-bench Machine Learning

Overcoming technical adoption barriers for mobile service robots in rehabilitation

2026-09-15 · Christian Sternitzke, Sebastian Blumenthal, Lukas Kleedoerfer, Verena Deserno 외 arxiv

Many publications on robotic systems in healthcare describe early-stage work on low technology readiness levels. This paper describes how a mobile service robot approved as a medical device reaches higher technology read…

RAIL: An Automatic Classifier of the Artificial Intelligence Readiness Level

2026-08-13 · Juan Irving Vasquez, Juan Terven, Laura-Ivoone Garay-Jimenez arxiv

Assessing the maturity of artificial intelligence technologies is essential for investment decisions, project management, and policy monitoring, yet the available readiness frameworks are heterogeneous and difficult to a…

A connected and automated vehicle readiness framework to support road authorities for C-ITS services

2023-11-02 · Bahman Madadi, Ary P. Silvano, Kevin McPherson, John McCarthy 외

Connected and Automated Vehicles (CAVs) can have a profound influence on transport systems. However, most levels of automation and connectivity require support from the road infrastructure. Additional support such as Coo…

A method for ethical AI in Defence: A case study on developing trustworthy autonomous systems

2022-06-21 · Tara Roberson, Stephen Bornstein, Rain Liivoja, Simon Ng 외

What does it mean to be responsible and responsive when developing and deploying trusted autonomous systems in Defence? In this short reflective article, we describe a case study of building a trusted autonomous system -…

EthicsTranslation