paper-with-me

홈 › Papers

Reliability, Resilience and Human Factors Engineering for Trustworthy AI Systems

2024-11-13 · Saurabh Mishra, Anand Rao, Ramayya Krishnan, Bilal Ayyub, Amin Aria, Enrico Zio

As AI systems become integral to critical operations across industries and services, ensuring their reliability and safety is essential. We offer a framework that integrates established reliability and resilience engineering principles into AI systems. By applying traditional metrics such as failure rate and Mean Time Between Failures (MTBF) along with resilience engineering and human reliability analysis, we propose an integrate framework to manage AI system performance, and prevent or efficiently recover from failures. Our work adapts classical engineering methods to AI systems and outlines a research agenda for future technical studies. We apply our framework to a real-world AI system, using system status data from platforms such as openAI, to demonstrate its practical applicability. This framework aligns with emerging global standards and regulatory frameworks, providing a methodology to enhance the trustworthiness of AI systems. Our aim is to guide policy, regulation, and the development of reliable, safe, and adaptable AI technologies capable of consistent performance in real-world environments.

📄 PDF Abstract BibTeX arXiv:2411.08981

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

"Think First, Verify Always": Training Humans to Face AI Risks

2025-07-23 · Yuksel Aydin arxiv

Artificial intelligence enables unprecedented attacks on human cognition, yet cybersecurity remains predominantly device-centric. This paper introduces the "Think First, Verify Always" (TFVA) protocol, which repositions …

Opening the Software Engineering Toolbox for the Assessment of Trustworthy AI

2020-07-14 · Mohit Kumar Ahuja, Mohamed-Bachir Belaid, Pierre Bernabé, Mathieu Collet 외

Trustworthiness is a central requirement for the acceptance and success of human-centered artificial intelligence (AI). To deem an AI system as trustworthy, it is crucial to assess its behaviour and characteristics again…

software testing

Microgrid Resilience: A Holistic and Context-Aware Resilience Metric

2021-06-17 · Sakshi Mishra, Ted Kwasnik, Kate Anderson

Microgrids present an effective solution for the coordinated deployment of various distributed energy resources and furthermore provide myriad additional benefits such as resilience, decreased carbon footprint, and relia…

Engineering AI Agents for Clinical Workflows: A Case Study in Architecture,MLOps, and Governance

2026-01-31 · Cláudio Lúcio do Val Lopes, João Marcus Pitta, Fabiano Belém, Gildson Alves 외 arxiv

The integration of Artificial Intelligence (AI) into clinical settings presents a software engineering challenge, demanding a shift from isolated models to robust, governable, and reliable systems. However, brittle, prot…

Explaining Uncertainty in Multiple Sclerosis Lesion Segmentation Beyond Prediction Errors

2025-04-07 · Nataliia Molchanova, Pedro M. Gordaliza, Alessandro Cagol, Mario Ocampo--Pineda 외

Trustworthy artificial intelligence (AI) is essential in healthcare, particularly for high-stakes tasks like medical image segmentation. Explainable AI and uncertainty quantification significantly enhance AI reliability …

Image SegmentationInformativenessLesion SegmentationMedical Image Segmentation+2