paper-with-me

Papers

A Methodology for Creating AI FactSheets

2020-06-24 · John Richards, David Piorkowski, Michael Hind, Stephanie Houde, Aleksandra Mojsilović

As AI models and services are used in a growing number of highstakes areas, a consensus is forming around the need for a clearer record of how these models and services are developed to increase trust. Several proposals for higher quality and more consistent AI documentation have emerged to address ethical and legal concerns and general social impacts of such systems. However, there is little published work on how to create this documentation. This is the first work to describe a methodology for creating the form of AI documentation we call FactSheets. We have used this methodology to create useful FactSheets for nearly two dozen models. This paper describes this methodology and shares the insights we have gathered. Within each step of the methodology, we describe the issues to consider and the questions to explore with the relevant people in an organization who will be creating and consuming the AI facts in a FactSheet. This methodology will accelerate the broader adoption of transparent AI documentation.

📄 PDF Abstract BibTeX arXiv:2006.13796

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Eval Factsheets: A Structured Framework for Documenting AI Evaluations

2025-12-03 · Florian Bordes, Candace Ross, Justine T Kao, Evangelia Spiliopoulou 외 arxiv

The rapid proliferation of benchmarks has created significant challenges in reproducibility, transparency, and informed decision-making. However, unlike datasets and models -- which benefit from structured documentation …

Improving LLM Performance Through Black-Box Online Tuning: A Case for Adding System Specs to Factsheets for Trusted AI

2026-03-11 · Yonas Atinafu, Henry Lin, Robin Cohen arxiv

In this paper, we present a novel black-box online controller that uses only end-to-end measurements over short segments, without internal instrumentation, and hill climbing to maximize goodput, defined as the throughput…

Towards an Accountable and Reproducible Federated Learning: A FactSheets Approach

2022-02-25 · Nathalie Baracaldo, Ali Anwar, Mark Purcell, Ambrish Rawat 외

Federated Learning (FL) is a novel paradigm for the shared training of models based on decentralized and private data. With respect to ethical guidelines, FL is promising regarding privacy, but needs to excel vis-\`a-vis…

EthicsFederated Learning

FactSheets: Increasing Trust in AI Services through Supplier's Declarations of Conformity

2018-08-22 · Matthew Arnold, Rachel K. E. Bellamy, Michael Hind, Stephanie Houde 외

Accuracy is an important concern for suppliers of artificial intelligence (AI) services, but considerations beyond accuracy, such as safety (which includes fairness and explainability), security, and provenance, are also…

Fairness

Event-Based Eye Tracking. AIS 2024 Challenge Survey

2024-04-17 · Zuowen Wang, Chang Gao, Zongwei Wu, Marcos V. Conde 외

This survey reviews the AIS 2024 Event-Based Eye Tracking (EET) Challenge. The task of the challenge focuses on processing eye movement recorded with event cameras and predicting the pupil center of the eye. The challeng…

Survey