paper-with-me

홈 › Papers

Quantitative AI Risk Assessments: Opportunities and Challenges

2022-09-13 · David Piorkowski, Michael Hind, John Richards

Although AI systems are increasingly being leveraged to provide value to organizations, individuals, and society, significant attendant risks have been identified and have manifested. These risks have led to proposed regulations, litigation, and general societal concerns. As with any promising technology, organizations want to benefit from the positive capabilities of AI technology while reducing the risks. The best way to reduce risks is to implement comprehensive AI lifecycle governance where policies and procedures are described and enforced during the design, development, deployment, and monitoring of an AI system. Although support for comprehensive governance is beginning to emerge, organizations often need to identify the risks of deploying an already-built model without knowledge of how it was constructed or access to its original developers. Such an assessment will quantitatively assess the risks of an existing model in a manner analogous to how a home inspector might assess the risks of an already-built home or a physician might assess overall patient health based on a battery of tests. Several AI risks can be quantified using metrics from the technical community. However, there are numerous issues in deciding how these metrics can be leveraged to create a quantitative AI risk assessment. This paper explores these issues, focusing on the opportunities, challenges, and potential impacts of such an approach, and discussing how it might influence AI regulations.

📄 PDF Abstract BibTeX arXiv:2209.06317

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Societal Capacity Assessment Framework: Measuring Resilience to Inform Advanced AI Risk Management

2025-09-26 · Milan Gandhi, Peter Cihon, Owen Larter, Rebecca Anselmetti arxiv

Risk assessments for advanced AI systems require evaluating both the models themselves and their deployment contexts. We introduce the Societal Capacity Assessment Framework (SCAF), an indicators-based approach to measur…

Could ChatGPT get an Engineering Degree? Evaluating Higher Education Vulnerability to AI Assistants

2024-08-07 · Beatriz Borges, Negar Foroutan, Deniz Bayazit, Anna Sotnikova 외

AI assistants are being increasingly used by students enrolled in higher education institutions. While these tools provide opportunities for improved teaching and education, they also pose significant challenges for asse…

The AI Revolution: Opportunities and Challenges for the Finance Sector

2023-08-31 · Carsten Maple, Lukasz Szpruch, Gregory Epiphaniou, Kalina Staykova 외

This report examines Artificial Intelligence (AI) in the financial sector, outlining its potential to revolutionise the industry and identify its challenges. It underscores the criticality of a well-rounded understanding…

FairnessFraud Detection

Toward a Human-Centered Evaluation Framework for Trustworthy LLM-Powered GUI Agents

2025-04-24 · Chaoran Chen, Zhiping Zhang, Ibrahim Khalilov, Bingcan Guo 외

The rise of Large Language Models (LLMs) has revolutionized Graphical User Interface (GUI) automation through LLM-powered GUI agents, yet their ability to process sensitive data with limited human oversight raises signif…

A Personal data Value at Risk Approach

2024-11-05 · Luis Enriquez

What if the main data protection vulnerability is risk management? Data Protection merges three disciplines: data protection law, information security, and risk management. Nonetheless, very little research has been made…

Management